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ABSTRACT 

Patterned after a model developed in Philadelphia in 
1964 without Federal funds, the Opportunities Industrialization 
Center (OIC) program emphasizes minority group leadership and seeks 
to attract the unemployed and underemployed who ordinarily would not 
have been attracted to public manpower programs. The program basic 
education, skill training, and job placement assistance. The five 
OIC * s reviewed have made measurable progress in enrollment, training, 
supportive services, job development, job placement, and community 
acceptance. However, efficient resource utilization requires 
improvement in operations and management. Specific areas for 
improvement are recruiting, counseling, training, job placement, 
followup, and evaluation. (BH) 
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OF THE UNITED STATES 



APRIL 20, 1972 




COMPTROLLER GENERAL OF THE UNITED STATES 
WASHINGTON, D*C. E0548 



B- 146879 



To the President of the Senate and the 
Speaker of the House of Representatives 

The General Accounting Office has made an assessment 
of the operations and management of Opportunities Industrial- 
ization Centers. Federal participation in this program is ad- 
ministered by the Department of Labor; the Department of 
Health, Education, and Welfare; and the Office of Economic 
Opportunity. This report presents our findings, conclusions, 
and recommendations based on this review. 

Our review was made pursuant to the Budget and Ac- 
counting Act, 1921 (31 U.S.C. 53), and the Accounting and Au- 
diting Act of 1950 (31 U.S.C. 67). 

Copies of this report are being sent to the Director, Of- 
fice of Management and Budget; the Secretary of Labor; the 
Secretary of Health, Education, and Welfare; and the Director, 
Office of Economic Opportunity. 




Comptroller General 
of the United States 
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COMPTROLLER GENERAL 'S 
REPORT TO THE CONGRESS 



ASSESSMENT OF OPERATIONS AND MANAGEMENT 
OF OPPORTUNITIES INDUSTRIALIZATION CENTERS 
Department of Labor 

Department of Health, Education, and Welfare 
Office of Economic Opportunity B-l 46879 



DIGEST 



WHY THE REVIEW WAS MADE • • 

The Senate Committee on Labor and Pu.bl ic Welfare has urged the. General 
Accounting Office (GAO) to provide the Congress with broad, independent 
appraisals of the management of Federal manpower programs by executive 
agencies. 

The Opportunities Industrialization Center (OIC) program— patterned after 
a model developed in Philadelphia, Pennsylvania, in 1964 without Federal 
support— emphasizes minority-group leadership and seeks to attract un- 
employed and underemployed persons who ordinarily, have not been attracted 
to public agency-sponsored manpower programs. The program provides en- 
rollees with motivational and basic work orientation, basic education, 
skill training, and job-placement assistance. GAO reviewed five OICs 
funded jointly by the Departments of Labor and of Health, Education, and 
Welfare (HEW) and by the Office of Economic Opportunity (0E0). 



FINDINGS AND CONCLUSIONS 
Overall qor^Vusiar^ 

The five OICs reviewed— Philadelphia; Milwaukee, Wisconsin; Dallas, Texas; 
Oklahoma City, Oklahoma; and Seattle, Washington— had made some measurable 
progress in enrolling persons in the program, providing training and sup- 
portive services, developing jobs, and making job placements. 

In addition, community acceptance of OIC?; was evidenced by the large num- 
ber of persons who had sought their services. Analyses of available rec- 
ords showed that the operations and management of the five OICs needed to 
be improved if available resources were to be used more effectively and 
efficiently. 

Information obtained on program results achieved at the five OICs provides 
some insight into the benefits resulting from the program as a whole. Ade 
quate data was not available, however, to compute the average cost for 
each enrollee or to assess the progress made in enhancing the employabil- 
ity of former enrol lees. 

GAO believes that the OIC program has promise and recognizes that some of 
the needed improvements will require additional resources. Finding solu- 
tions to OIC operating problems and effecting the necessary improvements. 
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though difficult and challenging, could greatly benefit not only the OIC 
program but the entire manpower effort of the Federal Government. (See 
p. 14.) 

Program results 

Analysis of records at the five OICs indicated that about 10,000 enrollees 
had participated in, and had terminated from, the program during the 
12-month periods covered by GAO's review. Of the 10,000 terminated en- 
rollees, 1 ,750 enrollees were placed in full-time jobs (1 ,450 had completed 
training and 300 had been placed prior to completing training), 250 had com 
pleted training but were not placed in jobs, 100 had transferred to other 
manpower programs, and 7,900 had dropped out prior to completing their 
training. While enrolled in the program, these enrollees attended, on the 
average, about half of the scheduled classes. (See p. 16.) 

As to the employment status of a sample of 495 former enrollees, GAO's 
inquiries of employers named in OIC records indicated that 67 had not 
been listed in the employers' records as having been employed and that 
428 had been employed. Of the latter employees, 227 still were employed 
at the time of the employers' responses. (See p. 17.) 

Jwproi>ewents needed in program operations 

Improvements were needed in several aspects of OIC program operations to 
provide a more effective training program. 

Recruiting 

Development and application of specific eligibility criteria were needed 
to ensure that the 1 imi ted funds available for manpower training are used 
to benefit those most in need of such training, that recruiting efforts 
are focused on a defined target population, and that everyone concerned 
is aware of the population to be served. Many of the enrollees in OICs 
would not qualify as disadvantaged under criteria established by Labor. 

(See p. 23. ) 

Counse ling 

OIC counseling programs could be improved if OICs 

—developed uniform techniques for determining the aptitudes, interests, 
and levels of achievement of prospective or new enrollees and used 
the results to aid the counselors and the enrollees in selecting the 
vocational training areas best suited to the enrollees; 

—counseled enrollees during training, both individually and in groups, 
on a regularly scheduled basis; 

—strengthened procedures for following up on, and If necessary ter- 
minating from the program, those enrollees who are absent for pro- 
longed periods of time or who leave the program before completion of 
training or placement in jobs; 
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--maintained more adequate records of counseling sessions; and 

■ * ’.v O * v : f * 1 * *’ ;• *' ... r 

--made greater efforts to determine' jth.e .specific causes of early termina- 
tions and absenteeism to ascertain what steps - might be taken to allevi- 
ate these problems. (See p;; 28:)'!-; vi • • , 

^evoca^ional and vocational training -/ . 

Three of the five OICs reviewed needed to establish, for both the prevoca- 
tional and vocational training components, standards against which an en- 
rol lee's needs, progress, readiness for advancement, and completion of 
training could be measured objectively and standards which could be used 
by program management as' a basis- for determining the, .effectiveness of the 
component. OIC needed also, to -evaluate periodically eac,h skill area of- 
fered to determine whether, in terms of enrol lee interest and job-placement 
potential, it was appropriate to continue each of them. (See pp. 35 and 
4 2. ) • 

Job placement _ • - 

OIC job-placement records and. reports to the. OIC National institute,. 'Inc. , 
were not always complete or accurate, nor were they always consistently 
maintained. The number of job placements reported by OICs, in many cases, 
had been overstated or could not documented. The job-placement records 
did not always show the amount of training provided or the nature of the 
jobs in which the enrol Tees -Were reported as having been placed. ........ 

More accurate, complete, and consistent classification and recording of 
job-placement and job-retention information would enable OICs to better as- 
sess the effectiveness of their programs .and :to ,enspre. : more reliable and 
informative reporting of- program 1 accompli shments-. 1 . ^S'be p.‘. 52.) 

Follow-up on ;job referrals and placements. ■ ( , 

OIC follow-up procedures needed to be improved, to ensure that former en- 
rol lees are provided with all assistance necessary for their obtaining and 
retaining stable employment and to obtain information necessary to evalu- 
ate program effectiveness. (See p. 56.) 

Improvements needed in program management 

The monitoring and evaluation efforts would be more effective if (1) they 
were made on a more systematic basis and responsibility for them was de- 
fined more clearly, (2) an assessment of program effectiveness and com- 
pliance with contractual requirements were included, and (3) prompt ac- 
tions were taken to implement needed improvements. Also OICs and the 
participating Federal agencies needed better operational data than was 
available, to more effectively manage the OIC program and monitor and 
evaluate its progress. (See p. 61.) 

Agreements in 1971 among Labor, HEW, 0E0, and the Institute provided that 
Federal funds from the three Federal agencies for the OIC program be 
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channeled through Labor. The funding of OICs by or through a single Fed- 
eral agency, if effectively implemented, should simplify accounting and 
reporting requirements, should eliminate many of the financial and opera- 
tional problems encountered by OICs and the three Federal agencies, and 
should result in a more efficient operation. Some proliferation of re- 
sponsibility remains, however, because each of the three Federal agencies 
continues to administer portions of the program. (See p. 67.) 



RECOMMENDATIONS OR SUGGESTIONS 

GAO is recommending that Labor, HEW, and 0E0 take the actions necessary to 
remedy the conditions noted above. (See pp. 26, 41, 50, 55, and 65.) 



AGENCY ACTIONS AND UNRESOLVED ISSUES 

0E0, Labor, and HEW generally concurred in GAO's recommendations. Labor 
advised GAO of the actions initiated during the 10-month period ended 
December 31, 1971. (See apps. Ill, IV, and V.) 



MATTERS FOR CONSIDERATION^ BY THE CONGRESS 

GAO is reporting ‘these matters to the Congress because of its expressed 
interest in how effectively and efficiently manpower training programs 
funded and administered by Federal agencies are operated. 

The Congress may wish to consider, in its deliberation of legislation 
that has been introduced as well as future manpower legislation, the in- 
formation contained in this report on the problems in the operations and 
management of the QIC program and, in particular, the need to centralize 
at the Federal -agency level the responsibility for the administration of 
the QIC program. (See p. 69.) 
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CHAPTER 1 



INTRODUCTION 

The Opportunities Industrialization Center program is 
somewhat unique among federally supported manpower training 
programs in that it was started by a group of private citi- 
zens without Federal funding. The first OIC, dedicated in 
Philadelphia in January 1964, was developed by a group of 
ministers led by the Reverend Leon H. Sullivan, a minister 
of the city's Zion Baptist Church. 

The Reverend Mr. Sullivan founded the Philadelphia OIC 
after discovering that many jobs secured for Blacks through 
a consumer boycott could not be filled because qualified 
Blacks were in short supply. In an old abandoned police 
station rented from the city at $1 a year, the Reverend 
Mr. Sullivan began enlisting the support of the community to 
be served by the center, gaining the confidence of the city's 
businessmen, and embarking on a self-help job- training pro- 
gram. Initially, funding of the OIC came from the local com- 
munity and private sources and, shortly after OIC opened, 
from the Ford Foundation. The QIC's first Federal funds for 
program components were provided by the Department of Labor 
in January 1965. 

Other OICs were established throughout the country and 
were modeled after the Philadelphia OIC. As of July 31, 

1971, 71 OICs were operational, and plans include provision 
for 100 OICs by June 1972. (See app. I for a listing of 
OICs.) Federal funds in the amount of about $12.2 million — 
provided by Labor and the Department of Health, Education, 
and Welfare under title II of the Manpower Development and 
Training Act of 1962, as amended (42 U.S.C. 2581), and by 
the Office of Economic Opportunity under the Economic Op- 
portunity Act of 1964, as amended (42 U.S.C. 2701) — consti- 
tuted the major source of financing of 17 OICs during fiscal 
year 1969. 

Fourteen OICs were provided with funds by Labor to 
carry out Concentrated Employment Programs; some OICs were 
provided with funds by the Economic Development Administra- 
tion of the Department of Commerce or by the Department of 
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Housing and Urban Development. During 1970, 18 OICs were 
funded in the amount of about $12.4 million by Labor, 0E0, 
and HEW. 

We reviewed the operations and selected administrative 
practices of five OICs which carry out manpower training 
programs in Philadelphia, Milwaukee, Dallas, Oklahoma City, 
and Seattle. We believe that these OICs, which were funded 
in the amount of about $5.5 million in both fiscal year 
1969 and fiscal year 1970 by Labor, OEO, and HEW, represent 
a cross section of the federally funded OICs; however, the 
matters presented in this report may or may not be represen- 
tative of other OICs or of the total OIC program. 

Our review was directed toward analyzing and evaluating 
the results of the OIC operations, the manner in which OICs 
were administered, and the manner in which the Federal fund- 
ing agencies carried out their responsibilities. Our review 
at four of the five OICs covered primarily calendar year 
1969 activities; at the Milwaukee OIC, we reviewed activi- 
ties for the 12-month period ended February 1970. At each 
OIC we evaluated actions taken subsequent to these periods — 
generally through June 1970 — on certain matters. 

We also reviewed the operations and selected adminis- 
trative practices of the OIC National Institute, Inc., in 
Philadelphia, which was funded by Labor and OEO during the 
period covered by our review. The Institute furnished tech- 
nical assistance and training services to the OICs included 
in our review except for the Philadelphia OIC. 

The amount of funds provided by Labor, OEO, and HEW to 
the five OICs included in our review and the funding periods 
covered are, as follows: 





Funding 


Period covered 


Federal funds provided 
(note a) 


Required 
non- Federal 
funding 


OIC 


agency 


From 


To 


Amount 


Total 


(note b) 


Dallas 


Labor 


8- 4-67 


2-28-70 


$ 359,123 








0E0 


8- 4-67 


2-28-70 


320,668 








HEW 


3- 4-68 


6-30-70 


398,018 


$ 1,077,809 


$ 144,585 


Milwaukee 


Labor 


6-15-67 


2-28-70 


482,380 








0E0 


6-15-67 


2-28-70 


482,213 








HEW 


2-15-68 


6-30-70 


642,956 


1,607,549 


146,350 


Oklahoma City 


Labor 


10- 1-66 


7-31-70 


928,367 








0E0 


9- 7-66 


3-31-70 


919,451 








HEW 


10- 1-66 


7-31-70 


877,636 


2,725,454 


347,328 


Philadelphia 


Labor 


1- 1-65 


9-12-69 


1,005,642 








0E0 


7- 1-65 


6-30-70 


10,026,480 








HEW 


6-19-67 


8-31-70 


3,648,060 


14,680,182 


2,026,004 


Seattle 


Labor 


11- 1-66 


12-31-69 


915,661 








0E0 


9- 1-66 


6-30-70 


1,686,681 








HEW 


11- 1-66 


11-30-69 


1,038,753 


$ 3,641,095 


$ 260,622 



Excludes funds for the Concentrated Employment Program. 

^Represents the minimum local contributions required under the Federal fund- 
ing agreements. 



OICs also obtain funding from State agencies and 
through community fund-raising efforts, industry contribu- 
tions, individual gifts, national religious group contribu- 
tions, and foundation grants. The Institute reported that, 
nationwide, Federal funds of approximately $46 million and 
private funds of $2.6 million had been invested in the OIC 
program by the start of 1970. 

Under the motto "we help ourselves," an OIC is expected 
to secure as much grass-roots support as possible from its 
community and especially from the people it serves. Self- 
help includes local , fund-raising drives and the use of as 
many volunteers as possible. Observers have commented that 
the Philadelphia OIC owes much of its success to the fact 
that the people served by OIC feel that, since they volun- 
teer to serve it and help pay for it, it is theirs and that, 
as a result, OIC has become a symbol of achievement for the 
poor in Philadelphia's ghetto community. This feeling ex- 
isted to varying degrees for the four other OICs. 
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The Seattle OIC began to pay stipends to some of its 
enroll ees in January 1970, but the four other OICs, in line 
with the self-help concept, did not pay training allowances 
or stipends to their enrollees. Many enroll ees, however, 
received public welfare assistance, were employed, or were 
supported by their families. At some OICs a small "brother- 
hood fund" existed to help enrollees who needed assistance 
to continue in the program; some OICs paid transportation 
allowances or provided free lunches to their enrollees. Lo- 
cal businessmen donated money, space, equipment, and/or in- 
structors to the OICs. 

An OIC, if funded by Labor, 0E0, and HEW, is generally 
a delegate agency (contractor for performing services) of 
the local community action agency. 0E0 and Labor usually 
provide funds for an OICs program, except vocational train- 
ing, through the community action agency. HEW usually pro- 
vides funds for vocational training directly to the OIC or 
through a State vocational training agency. 

The OIC program, intended for disadvantaged persons — 
those having low incomes, the unemployed, or the underem- 
ployed — is open to all persons regardless of education, 
skill level, race, or creed and generally includes the fol- 
lowing components: recruitment, orientation, counseling, 

prevocational training, vocational training, job placement, 
job development, and follow-up. Although each component is 
essential to the total program, the two basic components 
are prevocational and vocational training. 

The prevocational training component, often referred 
to as the "feeder program" is designed to instill trainees 
with the attitude, motivation, and basic education they 
need to prepare for, and to be "fed" into, the vocational 
training component or other job- training programs. Prevo- 
cational training may include classes in minority history 
and instructions in personal development, basic computa- 
tional and conversational skills, and good work habits. 

The vocational training component is designed to pro- 
vide skill training necessary to bring the trainee to the 
job-ready level, to continue the trainee's basic education 
and motivation for self-help and improvement as required, 
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and to provide such assistance and guidance as will prepare 
the trainee for employment. 

In addition to sponsoring their programs, some OICs act 
as subcontractors to provide one or more of their component 
services to persons in other Federal, State, and locally 
supported manpower training programs. Also some OICs have 
been approved by the Veterans Administration to provide 
training to veterans. 

Each OIC is governed by a board of directors — many of 
them poor people from the area served — and generally each 
has an advisory committee usually including representatives 
from business and labor. Generally an OIC staff is headed 
by an executive director and includes administrative and 
operating employees. The operating employees generally are 
organized along component lines, and each organizational 
segment has responsibility for one or more components. The 
OICs included in our review had staffs numbering from about 
55 in Dallas as of December 1969 to about 430 in Philadelphia 
as of November 1969. 
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QI C NATIONAL INSTITUTE, INC . 

When interest in the OIC program began to increase in 

1965, the need arose for an organization to provide techni- 
cal assistance and training in the philosophy and methods 
of organizing and operating programs similar to those of 
the prototype, the Philadelphia OIC. To satisfy this need 
the OIC Extension Institute was established late in 1965 
through a grant from a private source. The Extension Insti- 
tute later became the OIC National Institute. The Reverend 
Mr. Sullivan is the chairman of the board of directors of 
the Institute. 

The Institute received its first Federal funds in July 

1966. Equal amounts were provided by 0E0 and Labor. During 
1969 and 1970, generally the periods covered by our review, 
the Institute received about $620,000 annually from 0E0 and 
Labor to provide technical assistance and training services 
to 25 selected OICs receiving Federal funds. From July 1966 
through December 1970, the Institute received Federal funds 
of more than $2.7 million. Also the Institute receives con- 
tributions from private sources. 

At the time of our review, the Institute staff reviewed 
and evaluated the local OIC program operations and advised 
Labor, 0E0, and HEW of its findings through bimonthly prog- 
ress reports and periodic meetings. During the periods 
covered by our review, the Institute did not have authority 
to direct that changes or improvements be made in the local 
OIC program operations or administration. 

The Institute assisted the local OIC boards of directors 
and administrative staffs in developing their programs and 
in coordinating and communicating with Government agencies — 
local, regional, and national. This included assistance in 
developing proposals, doing research, and negotiating con- 
tracts . 

The Institute's staff, which numbered 38 persons in 
January 1970, was headed by an executive director. He was 
assisted by four regional directors and a training officer. 
Four regional teams worked directly with the local OICs. 

Each team consisted of a regional director and four or five 
specialists who were experts in one or more of the OIC pro- 
gram components or in fiscal management and administration. 

10 
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Under a Labor and HEW contract with the Institute, ef- 
fective March 1, 1971, the Institute's role regarding OICs 
changed and the Institute became a prime contractor for 
Labor to fund, manage, guide, monitor, and evaluate OICs and 
to report periodically on the program's activities. The 
local OICs became subcontractors under the contract and must 
meet the requirements of the Institute for program operation 
and management. 

Generally the contract specifies that the Institute: 

--Expand the number of training operations by providing 
basic program funding for 40 or more additional local 
OICs. 

— Include, under a bulk- funding contract, funding and 
program operation responsibility for OIC local con- 
tracts which currently are funded with Federal funds 
under the three- agency agreement. 

— Provide the necessary supportive functions, national 
organization structure, and contract management 
through a single-agency bulk-funding contract. 

OEO became a party to the contract in June 1971. An 
amendment to the contract in October 1971 provided that funds 
totaling $31.7 million be furnished to the Institute for con- 
ducting the OIC program through June 1972. The amount of 
funds to be provided by each of the three funding agencies 
follows . 

Labor $18,716,210 

HEW 6,983,790 

OEO 6,000,000 

$31,700,000 

The HEW and OEO funds were transferred to Labor, which is 
the contracting agency, to effect the single-agency- funding 
aspect of the contract. The Institute, however, having full 
responsibility for carrying out the national OIC program, 
must provide HEW with certain reports on institutional train- 
ing activities, in addition to providing the required peri- 
odic reports on OIC operations and management to Labor. 
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Under the contract the Institute has authority to direct 
that changes or improvements be made in the program opera- 
tions or management of OICs. 

The Institute's organization and staff have been ex- 
panded under the contract provisions for increasing the num- 
ber of OICs and for bringing all OICs under Federal fund- 
ing. Plans include a staff of about 120 persons to provide 
the national office and the six regional offices with the 
employees for advising, monitoring, and evaluating OICs. 

FEDERAL- AGENCY ADMINISTRATION 



At the Federal level, Labor, 0E0, and HEW were respon- 
sible for funding and administering the OIC program during 
the periods covered by our review. This responsibility was 
handled in Labor by the Office of Manpower Policy, Evalua- 
tion, and Research; in 0E0 by the Office of Operations; and 
in HEW by the Bureau of Adult, Vocational, and Technical 
Education of the Office of Education. 

The March 1971 Labor and HEW contract with the Insti- 
tute placed total responsibility for the management and per- 
formance of the national OIC program with the Institute and, 
in effect, administratively accomplished the single- agency- 
funding concept. Thus Federal funds from Labor, HEW, and 
OEO which became a party to the contract in June 1971, will 
be channeled to the Institute through Labor. Labor, acting 
as the lead agency, is to keep HEW and OEO apprised of OIC 
program policy changes and generally the results of Labor's 
monitoring and evaluation functions. 

The contract and subsequent agreements provide that: 

1. The Institute periodically furnish certain informa- 
tion to Labor and HEW. 

2. HEW maintain its statutory responsibility under the 
Manpower Development and Training Act of 1962, and 
participate in all changes affecting institutional 
training and related evaluations. 

3. OEO retain the fiscal and program responsibility 
for OICs funded in fiscal year 1971 under previous 
funding agreements. 



As these OICs are phased into the new national program, the 
community action agencies will be discontinued as prime 
sponsors for OICs. Provision has been made for 0E0 to be 
involved to the maximum extent possible as Labor carries out 
its evaluation and monitoring functions. Also the community 
action agency in the community where an OIC is located is 
to be given the opportunity to comment upon that OIC's fund- 
ing request when it is submitted to the Institute and Labor. 
Further 0E0 retains the authority to evaluate the overall 
program effectiveness and impact to ensure that the criteria 
for low- income program participants are being met. 

Although legislation to place the responsibility for 
the OIC program with Labor has been introduced and is pend- 
ing in the Ninety- second Congress, the national contract 
concerning Labor, HEW, 0E0, and the Institute is designed 
to administratively place primary responsibility on Labor 
and the Institute. 



o 

ERLC 



13 18 



CHAPTER 2 



OBSERVATIONS ON THE EFFECTIVENESS AND 
EFFICIENCY OF PICS 



The five OICs had made some measurable progress in en- 
rolling persons in the program, providing training and sup- 
portive services, developing jobs, and making job placements. 
In addition, community acceptance of OICs was evidenced by 
the large number of persons who had sought their services. 

We had considerable difficulty, however, in interpreting 
and analyzing many of the reported program results because 
these OICs had not realistically defined their objectives 
and because the program records were inadequate. The in- 
formation which GAO obtained on program results provides 
some insight into the benefits resulting from the OIC pro- 
gram. Adequate data was not available, however, to compute 
the average cost for each enrollee or to assess the progress 
made in enhancing the employability of former enrollees. 

Our analyses of the records that were available showed 
that improvements were needed in the operations and manage- 
ment of the five OICs before available resources could be 
used in a more effective and efficient manner. 

We recognize that some of the shortcomings at these 
five OICs can be attributed to the grass-roots origin of the 
OIC program and the problems involved in its growth. Pro- 
gram managers were, for the most part, inexperienced in op- 
erating a program of this nature, and emphasis was placed 
on showing visible results rather than on establishing well- 
designed and smoothly functioning administrative and opera- 
tional techniques. 

We believe that the OIC program has promise and that 
emphasis now should be placed on developing better adminis- 
trative, operational, and management techniques that will 
enable OICs to better serve their intended beneficiaries 
and to provide more reliable measures of and data on pro- 
gram accomplishments. 
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The results of the five OICs' programs and the improve- 
ments needed in their operations and management are summa- 
rized below and are discussed more fully in subsequent 
chapters. 

PROGRAM RESULTS 



Our analyses at the five OICs either of the records 
available or of a statistical sample of these records 
showed that about 10,000 enrollees had participated in, and 
had been terminated^- from, the. programs of the five OICs 
during the 12-month periods covered by our review. Summary 
information on the characteristics of these enrollees was 
not readily available at each OIC. Our samples^ of certain 
groups of enrollees at each of the five OICs, however, in- 
dicated the following general characteristics: 

— 62 percent were female. 

— 63 percent were ages 21 through 40. 

— 72 percent were Black. 

— 65 percent were unemployed at the time they entered 
the OIC. 

— 54 percent were not high school graduates. 

— 57 percent reported family incomes below the OEO 
poverty guidelines. 

--52 percent were heads of households. 

The following chart shows the status at time of termi- 
nation for these 10,000 enrollees. 



Terminations from the program occur when an enrollee (1) 
completes the program, (2) is placed in a job, (3) trans- 
fers to another training programs, or (4) drops out of the 
program. 

2 

See ch. 5 lor information on sample size and method of 
selection at each OIC. 
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Completed troining 
ond were ploced in 
full-time jobs 



1450 ( 15 %) 



Were ploced in full- 
time job'; prior to 
completing troining 



300 ( 3 %) 



Completed training 
but were not pi oced 
in a job 



250 ( 2 %) 



Transferred to other 
manpower programs 



100 ( 1 %) 



Of the 7,900 enrollees who dropped out prior to com- 
pleting training, 5,050 terminated during prevocational 
training and 2,850 terminated during vocational training. 
Because of their association with the program, they may have 
received some benefits from the training. While enrolled 
in the program, enrollees attended, on the average, about 
half of the .scheduled classes. 



As shown above, OICs have had some success in placing 
those trained into jobs. We noted, however, that disadvan- 
taged persons, those for whom the program was intended, had 
not always been served as effectively as the nondisadvan- 
taged. For example, at the Seattle OIC, about 51 percent 
of the enrollees were considered to be disadvantaged under 
Labor criteria but only 10 percent of those who had com- 
pleted training, had been placed in jobs, and were still 
employed were disadvantaged. 
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We examined into the employment status of a sample^- of 
495 former enrollees who, according to OIC records, were 
placed in full-time jobs during calendar year 1969 after 
receiving some vocational training. We made inquiries of 
the employers named in OIC records as having employed these 
enrollees. The named employers in responding to our in- 
quiries during a 5-month period, February through June 1970, 
stated that, of the 495 former enrollees, 67 had not been 
listed in their records as having been employed; that 428 
had been employed; and that, of these, 227 still were em- 
ployed at the time of employer responses. 

According to OIC records for those still employed, 66 
were male and 161 were female. They had been employed, on 
the average, about 8 months at the time of the employers' 
responses. The length of employment ranged from about 
2 months for some to over 18 months for others. Their earn- 
ings, which at the start of their employment had averaged 
from $1.85 an hour in Dallas to $2.62 an hour in Seattle, 
averaged from $2.05 an hour in Dallas to $2.75 an hour in 
Seattle at the time of the employers' responses. 

Of the 201 persons no longer employed — 80 male and 121 
female — 29 percent had worked for the employers less than 
1 month, 46 percent for 1 to 6 months, and 19 percent for 
more than 6 months. Information on length of employment 
was not provided for the remaining 6 percent. The employers 
reported that, of the persons no longer employed, 50 percent 
had left the jobs voluntarily — one sixth of these had in- 
formed the employer that they had obtained or were seeking 
other jobs — 15 percent had been laid off because of cut- 
backs in the work force; and 31 percent had been discharged 
because of excessive absenteeism, inadequate job perfor- 
mance, lack of skills, or other reasons. We were not pro- 
vided with reasons for separation for the remaining 4 per- 
cent. 

The earnings of those persons no longer employed, 
which at the start of their employment had averaged from 



See ch. 5 for information on sample size and method of 
selection at each OIC. 
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$1.81 an hour in Oklahoma City to $3.23 an hour in Seattle, 
averaged from $1.81 an hour in Oklahoma City to $3.30 an 
hour in Seattle at the end of their employment. 

Additional information on the enrollees in this sample 
is included in appendix II. 
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NEEDED IMPROVEMENTS 



Improvements were needed in four basic areas to make 
the program more effective and efficient in attaining its 
major objective — training or retraining persons who have un- 
developed talents and unknown skills and who are unemployed 
and underemployed. 

— First, OICs needed to make greater efforts to re- 
cruit and enroll disadvantaged persons, who are con- 
sidered to be most in need of the training and to- 
ward whom the program was to be primarily directed. 
Specific eligibility criteria for enrollment, 
coupled with more reliable screening procedures, 
would help ensure that the limited amount of funds 
available for manpower training is used to benefit 
those persons having the greatest need for such 
training. Many of the enrollees could not be classi- 
fied as disadvantaged under criteria established by 
Labor . 



— Second, OICs needed to retain enrollees in the pro- 
gram long enough for them to obtain adequate knowl- 
edge and skills necessary to obtain and hold jobs 
and to develop in them the habit of regular atten- 
dance, normally a basic job requirement. During the 
periods of our review, about 79 percent of the en- 
rollees who terminated from the program dropped out 
prior to completing their training; an enrollee at- 
tended, on the average, about half of the scheduled 
classes. The high dropout rate and generally poor 
class attendance limited the effectiveness of the 
program. 

— Third, more systematic and in-depth monitoring and 
evaluations of program operations and increased and 
timely follow-up after job placement were needed to 
enable OICs to better assess their achievements and 
progress toward meeting program objectives. Also 
these activities could result in the identification 
of improvements needed, changes needed in program 
emphasis, technical assistance needed by OICs, and 
additional assistance needed by the enrollees to re- 
tain their jobs. 
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— Fourth, the funding arrangements of OICs needed to 
be changed to reduce the administrative work loads 
of OICs and Federal agencies. During the period 
covered by our review, OICs were financed jointly by 
three Federal agencies, each of which had its own 
funding arrangements, reporting requirements, and 
administrative procedures. By agreements dated 
March 1971 and June 1971, the responsibility for 
funding OICs generally was centralized in Labor. 

In addition to improvements in the four basic areas, 
improvements were needed in various other aspects of the 
OIC program which, if made, would aid, to some extent, in 
effecting improvements in the basic areas. 

OICs needed to establish clearly defined and realistic 
criteria for determining enrollee progress land achievement. 
Uniform criteria for determining progress through and com- 
pletion of prevocational and vocational training courses 
would enable (1) the enrollee to be aware of his progress 
and of what he must accomplish to complete his training, 

(2) the prospective employer to have a clear understanding 
of the degree of training received by the enrollee, and 

(3) OIC management to measure the success of its training 
components. Also OICs needed to adopt a uniform policy for 
removing from program rolls those enrollees no longer at- 
tending classes to ensure that training slots no longer 
filled are made available for others and that accurate en- 
rollment and participation figures are available to man- 
agement. 

OICs needed to maintain more adequate and accurate 
records and to provide more informative reports on the 
various aspects of the program. We found that records had 
not been kept or were incomplete or had been inadequately 
maintained for most of the program components at the five 
OICs. The major inadequacy related to placement records. 
Also program accomplishments generally were overstated. 

For example, for job-placement activities, records 
varied from department to department within the centers; 
enrollees' records did not agree with summary reports; and 
the reported accomplishments sometimes included duplicate 
entries, multiple placements of the same enrollees, 
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placements of persons who had not received training in 
OICs, or placements of persons who were participants in 
other programs for which OICs provided certain supportive 
services. 

OICs also needed to make more intensive efforts to de- 
termine and analyze the ca\ises of absenteeism and early 
terminations from the program and to take action to allevi- 
ate such problems. Two methods which would aid in deter- 
mining the causes of such problems and which might indicate 
needed corrective action-scheduled periodic individual and 
group counseling for all enrol'lees and systematic follow-up 
on those enrollees who are absent for long periods or who 
leave the program prior to completion of training or job 
placement — were not being fully utilized by OICs. 

The problems encountered and improvements needed in 
OIC operations and management are not unique. They are 
similar to those in other federally funded manpower train- 
ing programs. We recognize that some of the improvements 
will require additional resources. We believe, however, 
that finding solutions to these problems and effecting the 
necessary improvements, though difficult and challenging, 
could greatly benefit not only OICs but the entire manpower 
effort of the Federal Government. 
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CHAPTER 3 



IMPROVEMENTS NEEDED IN PROGRAM OPERATIONS 



Improvements were needed in several aspects of OIC 
program operations to provide a more effective training 
program. Specific eligibility criteria were needed to en- 
sure that available resources are used to reach and serve 
those most in need of program services. The counseling 
programs could be improved by: 

— Developing uniform techniques for determining the 
interests, aptitudes, and capabilities of each pro- 
spective or new enrollee and using the results to 
aid the counselor and the enrollee to choose the 
vocational area best suited to the enrollee. 

— Providing regularly scheduled counseling during 

training and more timely follow-up counseling of en- 
rollees having high absenteeism rates. 

— Documenting the counseling sessions to ensure that 
the counselor is fully cognizant of the enrollee' s 
problems and progress and to facilitate continuity 
in the event of counselor turnover. 

The specific causes of early terminations and absen- 
teeism needed to be determined so that the causes can be 
analyzed and appropriate steps can be taken to alleviate 
these problems. 

OICs needed to establish, for both the prevocational 
and vocational training components, standards against which 
an enrollee' s needs, progress, and readiness to advance or 
training completion can be objectively measured and stan- 
dards which can be used by program management as a basis 
for determining the effectiveness of the components. Also 
OICs needed to periodically evaluate each skill area of- 
fered to determine whether it is appropriate, in terms of 
enrollee interest and job-placement potential, to continue 
each of them. 
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Job-placement information needed to be more accurately 
and consistently classified and recorded to enable better 
assessments of program effectiveness and to ensure more 
reliable end informative reporting of program accomplish- 
ments. 

Follow-up contacts needed to be made with enrollees 
referred to, or placed in, jobs or with their employers to 
ensure that the enrollees are provided with all assistance 
necessary to enable them to retain their jobs and to enable 
OICs to obtain information to evaluate and improve the OIC 
program. 

The above matters are discussed in detail in the fol- 
lowing sections of this chapter. 

TARGET POPULATION 

Development and application of specific eligibility 
criteria were needed to ensure that the limited funds avail- 
able for manpower training are used to benefit those per- 
sons most in need of such training. Also such criteria 
would serve to focus OIC recruitment efforts on a defined 
target population and enable OICs to better measure the 
effectiveness of their recruiting activities and the extent 
to which they are reaching those persons most in need of 
the OIC program. 

Recruiting efforts 

Recruiting methods used by OICs included (l) direct 
recruiting by the OIC staff, (2) referrals by current or 
former enrollees, (3) radio, television, and newspaper 
advertising, and (4) referrals from other agencies and com- 
munity groups. Our review of OIC records and discussions 
with OIC employees indicated that no single recruiting 
method had provided a majority of the enrollees at all OICs 
and that more than one method might have been involved in a 
person's being enrolled. For example, in Philadelphia 
referrals by current or former enrollees and friends were 
cited by the largest number of the new enrollees as the 
primary method by which they had been recruited. In Okla- 
homa City direct recruiting by the OIC staff was credited 
most often by the enrollees as the primary method of their 
recruitment . 
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In general, community acceptance of OICs appeared to 
have had a positive effect on recruiting activities. This 
was evidenced by the high percentage of enrollees who re- 
ported at the time of enrollment that they had been referred 
to the program by current and former enrollees, friends, 
local and State agencies, community groups, and other 
sources. For example, OIC records indicated that 65 percent 
of the enrollments in Philadelphia and nearly 30 percent 
in Dallas resulted from such referrals. A Milwaukee OIC 
official told us that about 45 percent of the OIC enrollees 
had been recruited through referrals from other agencies. 
Many of the remaining enrollments resulted from direct re- 
cruiting by the OIC staffs. 

Eligibility criteria 

The main purpose of OIC recruitment efforts was to 
contact the hard-to-reach unemployed and underemployed res- 
idents of the target community and encourage them to take 
advantage of the training and employment services available 
through the OIC program. Specific income or other criteria 
to determine whether persons recruited and enrolled fell 
into such a category, however, were not established on a 
programwide basis. Rather each OIC was allowed to estab- 
lish its own criteria. 

In Philadelphia and Milwaukee, OICs established open- 
door policies and generally did not screen the applicants. 

In Philadelphia, the primary target groups were the unem- 
ployed and the underemployed, but specific criteria were 
not established to aid the recruiters in determining 
whether applicants were in these categories. A Milwaukee 
OIC official informed us that the OIC had not sought out 
any particular target group because, if the OIC concen- 
trated specifically on the unemployed and the disadvantaged 
persons who should be in the program, enrollment would be 
too low and the dropout rate too high. 

Dallas and Oklahoma City OIC officials informed us 
that they generally used 0E0 poverty guidelines to deter- 
mine whether applicants were disadvantaged. Oklahoma City 
OIC officials said, however, that some persons were enrolled 
regardless of income if the officials believed that the 
program would benefit them. In Seattle we were informed 
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that only those applicants who appeared to lack motivation 
were screened out. 



Although specific prograinwide eligibility requirements 
were not established for enrollment, Labor established 
criteria to determine, for OIC reporting purposes, whether 
a person was disadvantaged. These criteria provided that 
a person (1) meet the 0E0 poverty guidelines, (2) be unem- 
ployed, be underemployed, or be hindered from seeking work, 
and (3) be a member of one or more of the following groups: 



a. School dropouts . 

b. A minority. 

c. Those under 22 years of age. 

d. Those 45 years of age or over. 

e. The handicapped. 



If such criteria had been in effect at the OIC's, many 
enrollees would not have qualified as disadvantaged. For 
example, our tests of enrollee records showed that the per- 
centage of persons enrolled who did not qualify as disad- 
vantaged under 0E0 poverty guidelines — only one of the 
three criteria which would have had to be met — ranged from 
about 20 percent at the Oklahoma City OIC to over 55 per- 
cent at the Philadelphia CIC. 

One factor that may have discouraged more disadvantaged 
persons from seeking to enroll was the OIC policy of not 
paying stipends to enrollees. We were informed by Seattle 
OIC recruiters that stipends had been paid to some of its 
enrollees since January 1970 and that the arrangement had 
made its recruiting efforts easier. A Milwaukee OIC offi- 
cial stated that more benefits would be needed, such as 
transportation and free lunches, to aid that OIC in attract- 
ing and retaining disadvantaged persons. 



The proposed Employment and Manpower Act of 1970 would 
have established the OIC program as a specific Federal man- 
power training program. Although vetoed by the President, 
the proposed act indicated that the Congress desired the 
OIC program to be directed to low- income persons who are 
unemployed or underemployed. The same intent is expressed 
in proposed legislation that was before the Congress in 
January 1972. 
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Conclusion 



Specific eligibility criteria should be set forth in 
the OIC funding agreements and should be enforced to ensure 
that the limited manpower-training funds are used to benefit 
those persons most in need of such training, that recruiting 
efforts are focused on a defined target population, and 
that everyone concerned is aware of the population to be 
served. Also such criteria would enable OICs to better 
measure the effectiveness of their recruiting activities and 
the extent to which OICs are reaching those persons most in 
need of OIC services. 

Recommendations to the Secretaries of Labor 

and of Health, Education, and Welfare 

and to the Director, Office of Economic Opportunity 



We recommend that the three Federal agencies develop 
for inclusion in future funding agreements with OIC speci- 
fic uniform eligibility requirements directed toward re- 
cruiting low-income persons who are unemployed or underem- 
ployed. ' We recommend also that the three agencies provide 
the necessary guidelines and technical assistance to direct 
the recruiting activities toward the defined target popula- 
tion. 



By letter dated October 18, 1971 (see app. Ill), 0E0 
informed us that it had entered into an interagency agree- 
ment transferring OEO’s responsibility for OICs to Labor 
effective July 1, 1971. OEO added that, although 0E0 always 
had imposed on its OIC grantees the requirement to enroll 
persons that met the 0E0 poverty guidelines, the poverty- 
guidelines criteria had not been rigidly enforced during 
the development years of OIC to allow for program accept- 
ability in the communities. Thus a percentage of marginally 
poor persons have been attracted to OIC. The great majority 
of OIC enrollees, however, have been eligible for training 
under the OEO poverty guidelines. The single-agency-funding 
arrangement is designed to cure this problem. OEO will 
stand ready to assist Labor in seeing that this recommenda- 
tion is implemented. 
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HEW, by letter dated September 8, 1971 (see app. IV), 
advised us that it concurred in the recommendations and 
that all individual OICs would be funded through a single 
direct contract with the Institute. This approach should 
encourage the development of more uniform requirements in 
all areas. HEW stated that, although recruitment is a 
function of the U. S. Employment Service, HEW is cooperating 
with Labor in an attempt to improve the procedures. 

By letter dated December 30, 1971 (see app. V), Labor 
advised us of the action taken in regard to our recommenda- 
tions. Labor cited its single-agency bulk- funding agree- 
ment with the Institute which, under the agreement, is 
responsible for the management and performance of individual 
OICs. Labor stated that effective action had been taken 
under the agreement to establish clearly defined and realis- 
tic criteria for enrollment of the unemployed and underem- 
ployed . 
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COUNSELING PROGRAM 



OIC counseling programs, designed to give encouragement 
and assistance to all participants to enroll in the program 
and to complete the training, needed to be improved. This 
could be accomplished by: 

— Developing uniform techniques for determining the ap- 
titudes, interests, and levels of achievement of 
prospective or new enrollees to aid the counselors in 
assisting them in selecting realistic career objec- 
tives and vocational training areas best suited to 
reaching their objectives; 

- — Counseling enrollees during training, both individ- 
ually and in groups, on a regularly scheduled basis. 

— Strengthening procedures for following up on and, if 
necessary, terminating from the program those en- 
rollees who are absent for prolonged periods of time 
or who leave the program before completion or place- 
ment in a job. 

Also some of the OICs needed to maintain more adequate 
records of counseling sessions, and all five OICs needed to 
make greater efforts to determine the specific causes of 
early terminations aind absenteeism to ascertain what steps 
might be taken to alleviate these problems. 

Design of counseling progra m 

. The OIC program recognizes effective counseling as an 
integral and essential factor in an enrollee' s success. 
Therefore the funding agencies* agreements with OICs typi- 
cally provide for making counseling services available to 
each person before or at the time he enrolls in the program, 
during his progression through the program, and after he has 
been placed in a job. Often the enrollee is assigned to a 
single counselor who then becomes the focal point of commu- 
nication between the program and the enrollee. 

Each OIC has a designated counseling staff responsible 
generally for conducting preenrollment or intake interviews: 
participating in enrollee orientation; providing guidance, 
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encouragement, and assistance during training; following up 
on enrollees absent from class and those leaving the program 
prior to completion; determining, in cooperation with in- 
structors or other staff members, when an enrollee is to be 
terminated from the program; and maintaining enrollee rec- 
ords. Some counseling staffs are responsible also for con- 
tinued counseling of enrollees after they have been placed 
in jobs. 

Preenrollment or intake counseling 

The procedures at each OIC provide for a counselor or 
counselor-aide to meet with an enrollee immediately before 
or after entering the program to record personal data, dis- 
cuss personal problems, and help in developing vocational 
goals. None of the OICs, however, have developed uniform 
techniques for determining an enrollee' s vocational interests 
and aptitudes to assist the counselors and enrollees in se- 
lecting vocational courses offering the best chance of suc- 
cessful future employment. Although the final choice of vo- 
cational training should be and is made by the enrollee, we 
believe that the lack of uniform techniques for determining 
vocational interests and aptitudes has hindered the counsel- 
ors in definitely assessing the enrollee' s chances of success 
in his chosen vocation and in assisting the enrollee in mak- 
ing the best choice. 

Three OICs — Philadelphia, Seattle, and Oklahoma City — 
gave tests to determine the reading and mathematical abili- 
ties of enrollees and the levels at which they should enter 
prevocational training, but such tests generally were not 
useful in determining the enrollees' interests or aptitudes 
in particular vocations. At the Milwaukee OIC the need for 
testing new enrollees to determine their aptitudes and inter- 
ests was recognized by program officials, but such tests were 
not given. 

At the Dallas OIC we were advised that testing of en- 
rollees at intake to determine their reading and mathematical 
abilities was discontinued in February 1970 because the board 
of directors believed that the tests were driving away many 
prospective enrollees. The Dallas OIC counseling supervisor, 
however, told us that some type of testing should be done 
during the enrollee 's orientation period and that the OIC 
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funding proposals have stated that the administration and in- 
terpretation of tests are significant aspects of counseling 
and guidance activities. 

Counseling during training 

The funding proposals or written policies of each OIC 
stated that, during prevocational and vocational training, 
periodic individual and group counseling would be provided 
generally once a week and that individual counseling also 
would be available to the enrollees on request. 

Our review of counseling records and our interviews 
with both active and terminated enrollees revealed, however, 
that most enrollees, except for those at the Seattle OIC, 
had not received counseling as frequently as program offi- 
cials had deemed desirable. In some instances the records 
did not evidence that the enrollees had received any coun- 
seling or that, if they had, what problems or other matters 
had been discussed. Further some enrollees at the Dallas 
OIC informed us that they were not aware or were not sure 
that counseling was available to them at their request. 

Follow-up on absentees and dropouts 

Procedures at each OIC provided for the counselors to be 
notified after an enrollee had been absent 1 to 5 consecu- 
tive days — depending on the OIC — so that a counselor could 
contact the enrollee to determine the reasons for his absence 
and encourage him or provide the assistance he needed to re- 
turn to class. In spite of the high dropout rates experi- 
enced by OICs, such follow-up contacts were not made in many 
cases. 



Follow-up procedures were not followed at the Dallas 
OIC. For example, the folders of 43 of 50 calendar year 1969 
prevocational training program dropouts contained no evidence 
that follow-up contacts had been made, although their atten- 
dance records showed two or more absences. At the Milwaukee 
OIC, where an OIC official informed us that counselors gen- 
erally followed up on enrollees after three consecutive ab- 
sences, records indicated that few follow-ups actually had 
been made. According to officials of other OICs, the lack 
of funds and the difficulty in locating enrollees who were 
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absent or had dropped out were the main reasons for the lim- 
ited number of follow-ups. 

Also none of the OICs adequately evaluated the reasons 
for early terminations and absenteeism, to ascertain whether 
they could be alleviated through additional services, modifi- 
cation of program content, or such other means as might have 
been indicated. 

Termination policies 

/ 

Either OICs did not have specific termination policies, 
or, at the OICs that did have them, the counselors, who gen- 
erally had the responsibility for officially terminating en- 
rollees from the program, did not follow them. Therefore 
dropouts and enrollees having prolonged absences sometimes 
were carried on the program rolls for several months before 
they were officially terminated. These persons thus filled 
training slots that could have been made available for oth- 
ers. During the periods these persons remained on the rolls, 
enrollment figures and absentee rates were overstated and 
dropout rates were understated. 

For example, we were informed that the Milwaukee OIC 
had not established criteria for use by the counselors in 
initiating follow-up of enrollees having attendance problems 
for either reinstatement in the program or termination. As 
a result, although the education department notified the 
counselors daily of enrollee absences, the counselors, in 
many cases, did not initiate follow-up action nor officially 
terminate the enrollees for several months. 

In the meantime, the enrollees were credited with long 
periods of program participation, absentee rates were over- 
stated, dropout rates were understated, and inflated enroll- 
ment figures were reported by the OIC. 

Conclusions 



Success in training is dependent, in large part, upon 
effective counseling and guidance which, in turn, is depen- 
dent on the counselor's knowledge of the enrollee 's apti- 
tudes, interests, abilities, disabilities, and personal prob- 
lems which may hinder successful completion of training and 
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job placement. Intake interviews provide some of the infor- 
mation needed by the counselor, but appropriate measurement 
devices, such as standardized tests or work-assessment tech- 
niques, often can provide more definitive information about 
an enrollee* s aptitudes and interests and about whether his 
capabilities are consistent with employment requirements in 
the field he chooses. With such information, the counselor 
could better assist the enrollee in selecting the training 
area commensurate with his interests, aptitudes, and capa- 
bilities. 

During training, individual counseling should continue 
to be available at the request of the enrollee but, in the 
light of the dropout rates experienced by the OICs and the 
reluctance of some enrollees to seek assistance, individual 
and group counseling should be given on a regularly sched- 
uled basis. Appropriate records should be kept of each 
counseling session. 

Regularly scheduled counseling would enable early iden- 
tification and timely solution of problems and would ensure 
the enrollee of the OIC's continued interest in his prog- 
ress. Appropriate counseling records would facilitate con- 
tinuity when there is a turnover of counselors and would 
provide up-to-date information on an enrollee* s needs and on 
what has been or should be done to meet them. 

For a participant to derive sufficient benefits to en- 
able him to become self-sufficient, active participation in, 
and completion of, the training program is highly desirable 
if not essential. Therefore OICs should make follow-ups 
early on those enrollees who are absent from the program and 
should offer them encouragement and assist them to complete 
the program. To ensure that training slots are not filled 
by persons who no longer are interested in the program, uni- 
form termination policies should be established and fol- 
lowed. 

Also OICs should examine into the reasons for early 
terminations and prolonged absences of enrollees to ascer- 
tain whether such problems can be alleviated through addi- 
tional services, changes in program content, or other means, 
as may be indicated. 
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Agency actions 



In a draft report, we proposed that the Secretaries of 
Labor and of HEW and the Director, 0E0, together with the In- 
stitute, encourage OICs to: 

— Develop and use appropriate uniform measurement de- 
vices which will assist in determining enrollees' vo- 
cational interests and aptitudes and levels of 
achievement in reading and mathematics. 

— Provide individual and group counseling on a regularly 
scheduled basis to all enrollees and maintain appro- 
priate records thereon. 

— Strengthen procedures for following up on and, if 
necessary, terminating from the program those en- 
rollees absent for long periods or leaving the pro- 
gram prior to completion of training or job placement. 

— Identify the factors that cause enrolles to become 
inactive or to drop out of the program prior to com- 
pletion and take whatever action is necessary to al- 
leviate such causes. 

0E0 stated in response to our first proposal that it 
believed and its monitoring indicated that the feeder pro- 
gram, which is the prevocational component, provides the en- 
rollee with a degree of those uniform measurement devices. 

0E0 recognized, however, that the feeder program's effec- 
tiveness varied significantly from program to program and 
stated that 0E0 would assist Labor in improving the overall 
feeder program. 

Regarding our second proposal 0E0 considered that OICs 
had done group and individual counseling to some degree and 
that counseling was an important aspect of the program's 
design. 0E0 agreed, however, that a more structured coun- 
seling program should be implemented. 

0E0 indicated that it agreed with our third proposal 
but felt that, under termination standards and procedures, 
flexibility should be employed to guard against killing the 
motivational factor of enrollees. 
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OEO agreed with the last proposal and said that individ- 
ual counseling should be increased and that such counseling 
would aid in identifying enrollee problems. OEO saw some 
evidence that the enrollees' participation in the program re- 
cently was increased by the OICs to create a situation in 
which better communication would be established (i.e., mem- 
bership on OIC board of directors). OEO stated that this 
involvement would serve to identify enrollee problems and to 
improve and strengthen the program. 

HEW concurred in our proposals and stated that HEW had 
made provisions for the Institute to receive necessary 
guidance from the Area Manpower Institutes for the Develop- 
ment of Staff Centers funded under the Manpower Development 
and Training Act and located in seven strategic areas 
throughout the country. 

Labor stated that OICs were using various programmatic 
measurement devices which the Institute, pursuant to its re- 
sponsibility under the contractual arrangement for manage- 
ment and performance of individual OICs, had developed for 
determining enrollees' vocational interests and aptitudes 
and had implemented procedures to ensure that adequate indi- 
vidual and group counseling was provided and was recorded in 
the enrollees' permanent records. Labor stated also that 
the Institute had issued standards and was assisting OICs in 
the adoption of uniform termination policies designed to en- 
sure that training slots are not filled by persons uninter- 
ested in the program. Labor also said that termination in- 
terviews with enrollees were being considered as a method for 
determining causes of dropouts and that, to the degree that 
more effective counseling could reduce employee discontinu- 
ance, OICs were employing this technique. 



EFFECTIVENESS OF PREVOCATIONAL TRAINING 



QIC records indicated that, of approximately 8,800 
enrol lees who had participated in, and had terminated from, 
the prevocational training components during the periods 
covered by our review, about 43 percent had enrolled in 
the OIC vocational training component, had entered other 
manpower training programs, or had obtained jobs. The re- 
mainder dropped out during prevocational training. While 
enrolled in prevocational training, enrollees attended, on 
the average, about half of the scheduled classes. Also, 
except for the Seattle OIC, OICs did not establish, or did 
not always follow, standards to objectively measure enrollee 
needs, progress, and readiness for vocational training. 

The effectiveness of the prevocational training compo- 
nent could be improved and the benefits received by enrollees 
could be increased by improving enrollees* class attendance 
rates, retaining enrollees in the program, and establishing 
and following standards to measure enrollee needs , progress , 
and readiness for vocational training. Also such standards 
could be used by OIC officials as a basis for measuring 
the effectiveness of the prevocational training component, 

Prevocational training design 

Prevocational training classes at each OIC were offered 
during both the day and evening. Although some OICs, no- 
tably the one in Milwaukee, allowed some enrollees to bypass 
prevocational training and be placed directly into vocational 
training, most enrollees who entered the OIC program ini- 
tially were placed in the prevocational training component. 
There, to the extent considered necessary, they received 
instruction in basic education, communication and computa- 
tional skills, personal development, minority history, and 
job-finding techniques or assistance in preparing for the 
high school diploma equivalency examination or Civil Ser- 
vice examinations. The courses were designed to instill 
confidence, provide attitudinal and motivational develop- 
ment, and increase educational skills to a level necessary 
to enter vocational training and eventually to obtain and 
hold a job. 
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Generally, conventional teaching techniques were used 
and instructors were college graduates. Enrollees generally 
progressed at their own pace and were instructed individually 
because of the continuous turnover of enrollees and their 
varying ability levels. At some OICs enrollees were clus- 
tered according to vocational goals to permit subjects to 
be taught at appropriate depths. 

Overall results of 
prevocational training component 

Our analyses at the five OICs of enrollee termination 
information in either the OIC records or a statistical sam- 
ple of these records indicated that approximately 8,800 en- 
rollees had participated in, and had terminated from, the 
five OIC prevocational training components during the 12- 
month periods covered by our review. On the basis of our 
analyses, we found that: 

— 3440, or 39 percent, had transferred from prevoca- 
tional training to vocational training. 

— 250, or 3 percent, obtained or had been placed in 
jobs either during or upon completion of prevocational 
training. 

— 40, or 1 percent, had transferred to other programs, 
such as the Concentrated Employment Program or the 
Job Opportunities in the Business Sector program. 

— 5,050, or 57 percent, had dropped out before complet- 
ing prevocational training or being placed in jobs 
or in other manpower training programs. 

Enrollee attendance 



Our review of records indicated that the average daily 
attendance in the prevocational training courses at the 
five OICs ranged from 35 percent of enrollment at the Mil- 
waukee OIC to 60 percent of enrollment at the Seattle OIC. 
The corresponding rates of absenteeism — ranging from 65 per- 
cent at Milwaukee to 40 percent at Seattle — were attribut- 
able, in part, to the OIC practice, as discussed earlier, 
of retaining inactive enrollees on program rolls for long 
periods before they were officially terminated. 
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We were informed by OIC officials or enrollees that 
absenteeism was generally attributable to conflicts between 
the class schedules and job hours of enrollees who were 
employed, to transportation difficulties, and to health and 
family problems. 

Three OICs — Dallas, Oklahoma City, and Seattle — made 
some attempts to increase enrollee attendance, but these 
efforts were not always successful. The Dallas OIC began 
enforcing a procedure in March 1970 to involve enrollees 
and instructors in encouraging absent enrollees to attend 
classes. Enrollees were requested to advise OIC when they 
were going to be absent. 

Our analysis of the Dallas OIC's attendance data for 
a 1-month period in mid- 1970 showed, however, that the 
average attendance rates for that period — 45 percent for 
day classes and 25 percent for evening classes — had dropped 
below the attendance rates for selected periods in 1969 — 

48 percent for day classes and 30 percent for evening 
classes. A Dallas OIC official informed us in July 1970 
that, in a further effort to increase attendance, responsi- 
bility for follow-ups on absent enrollees had been dele- 
gated to a newly established department within the OIC and 
that new procedures concerning follow-ups were being pre- 
pared. 

At the Oklahoma City OIC, instructors contacted absent 
enrollees by telephone or counselor-aides visited those 
who could not be reached by telephone. The contacts were 
aimed at resolving problems that were keeping the enrollees 
from attending classes. Using these procedures, however, 
did not increase average enrollee attendance; it remained 
at the 50-percent level. 

The Seattle OIC began paying stipends in January 1970 
to some OIC enrollees. Our analysis of attendance data for 
the 6-month period ended June 1970 showed that the average 
rate of attendance had increased to 75 percent from the 
rate of about 60 percent in 1969. The stipends, which were 
reduced for unexcused absences, probably contributed signif- 
icantly to the higher attendance rate. Another factor con- 
tributing to the higher rate was the OIC's practice, which 
started in January 1970, of officially enrolling a person 



only after he had 2 weeks of orientation. This practice 
probably resulted in the decrease of about 40 percent in 
enrollments in 1970. 

We were not apprised of any special efforts to improve 
enrollee attendance at the Milwaukee and Philadelphia OICs. 

Dropout rate 

The average dropout rate for enrol lees who terminated 
from the prevocational training components at the five OICs 
during the periods covered by our review was about 57 per- 
cent, overall, and ranged from about 48 percent at the 
Oklahoma City OIC to about 90 percent at the Milwaukee OIC. 
Although the records for some prevocational training en- 
rollees showed the enrollees ' reasons for dropping out of 
the program, not all enrollee records showed such informa- 
tion. We did not find any evidence that OICs had made de- 
tailed analyses to determine the underlying causes or to 
determine what action was needed to reduce the number of 
enrollees dropping out. 

The available records and our interviews with former 
enrollees showed that the primary reasons given by the en- 
rollees for dropping out of the program were (l) conflict 
with the enrollee' s existing job, (2) loss of interest in 
the program, (3) health problems, and (4) personal and 
family problems. 

At the Seattle OIC, which began in January 1970 to pay 
stipends to enrollees and to enroll persons only after they 
had completed 2 weeks of orientation, we noted that the 
dropout rate for prevocational trainees, which was about 
50 percent in 1969, had decreased to 37 percent for the 
first 6 months of 1970. Except for these actions by the 
Seattle OIC and those steps previously discussed with re- 
spect to absenteeism at the Dallas and Oklahoma City OICs, 
no evidence was found that specific steps were being taken 
by OICs to reduce the dropout rate for prevocational train- 
ing enrollees. 
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Enrollee progress 



Each OIC had its own method for determining an en- 
rollee' s needs, his progress in the prevocational training 
component, and his readiness for vocational training. At 
the time of our review, the Oklahoma City and Seattle OICs 
had established standards to be used in making such deter- 
minations; the three other OICs had not. Also, the Seattle 
OIC, as a general rule, formally measured enrollee progress 
against these standards; records at the Oklahoma City OIC 
indicated that it had done so for about half of its en- 
rollees . 

At the Seattle OIC, guidelines were established in 
January 1970 setting forth what a trainee must be able to 
do before he could be transferred to his chosen vocational 
training area and enrollees were tested during prevocational 
training to measure their proficiency in the required opera- 
tions. For example, an enrollee wishing to enter the draft- 
ing course had to demonstrate that he could multiply deci- 
mals and extract square roots before being advanced, 

At the Milwaukee OIC, where standards had not been 
established and where enrollees had not been required to 
take prevocational training, some attempts were made to 
measure progress in prevocational training through teacher 
evaluations. We found that the evaluations were too general 
to be of much use, however, and that most enrollees who had 
taken prevocational training were advanced to vocational 
training at their own request rather than as a result of 
such evaluations. 

The Milwaukee OICs records showed that only 42 of 
the 846 enrollees who participated in, and terminated from, 
the prevocational training component during the 12-month 
period covered by our review had advanced to the vocational 
training component. The remainder dropped out or obtained 
j obs. 



At the Philadelphia OIC, enrollees were tested in 
reading and mathematics prior to starting prevocational 
training but standards were not established and enrollees 
were not systematically retested to ascertain their educa- 
tional achievement or readiness for vocational training. 
Rather a counselor- ins true tor team made the determination. 
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Generally the Dallas OIC's instructors determined by 
their own methods, such as ungraded quizzes or observation, 
an enrollee's readiness for vocational training, because 
standards had not been established and formal testing was 
not required. 

In some cases enrollees were transferred to vocational 
training before completing prevocational training in order 
that the minimum enrollment required to start a vocational 
training class could be met. A Dallas OIC official informed 
us in July 1970 that the OIC was planning to develop a 
series of tests to measure enrollee progress, that the in- 
structors would be required to record enrollee progress 
weekly, that a four-member evaluation team had been formed, 
and that one of the team 1 s functions would be to make a final 
evaluation and report on enrollee readiness for vocational 
training. 

Cone lusions 

To receive substantial benefits from their OIC experi- 
ence, enrollees need to stay in the training program a suf- 
ficient time to acquire adequate knowledge and skills and 
to develop attitudes and work habits necessary to qualify 
for and become successful in a job. The inability of OICs 
to retain enrollees during prevocational training and to 
assist them in developing the habit of regular attendance, 
normally a basic job requirement, is a significant problem, 
the contributing causes of which OICs did not take suffi*- 
cient action to identify and minimize. 

Also clearly defined and realistic standards should 
be established by those OICs which did not do so for use 
by program officials in assessing enrollee needs and prog- 
ress and in determining when prevocational training en- 
rollees attain sufficient knowledge and basic skills neces- 
sary for successful participation in and completion of voca- 
tional training. In addition, such standards would provide 
a basis for OICs to better measure the effectiveness of the 
various aspects of their prevocational training component. 




Recommendation to the Secretaries of Labor 

and of Health, Education, and Welfare 

and to the Director, Office of Economic Opportunity 

We previously have made a proposal regarding absentee- 
ism and early terminations. Regarding the need for stan- 
dards, we recommend that the three Federal agencies assist 
OICs to establish uniform, clearly defined, and realistic 
standards to be used both for assessing enrollee needs, 
progress, and readiness for advancement and for evaluating 
the effectiveness of the prevocational training component. 



0E0 concurred in our recommendation and stated that 
prevocational standards were necessary and that, in the 
light of the recent OIC transfer to Labor, 0E0 would assist 
Labor as much as necessary so that the OIC program would 
continue to improve its prevocational training component. 

HEW concurred in our recommendation and commented that 
it was expected that, through the single-contract concept, 
more uniform and clearly defined standards would be devel- 
oped. 



Labor advised that procedures were being formulated 
for measuring and evaluating enrollee progress toward com- 
pletion of prevocational training. 
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VOCATIONAL TRAINING COMPONENT 



OIC records indicated that, of approximately 4,630 en- 
rollees who participated in and terminated from the voca- 
tional training components during the periods covered by 
our review, about 36 percent were considered to have com- 
pleted training, 2 percent had been transferred from the 
vocational training component to other manpower training 
programs or had been placed in jobs prior to completing 
training, and the remaining 62 percent had dropped out 
prior to completion. 

OIC records indicated also that, of those who were 
considered to have completed training, about 85 percent had 
been placed in jobs and the other 15 percent were awaiting 
placement at the time they were terminated from the pro- 
gram. While enrolled in the vocational training component, 
enrollees attended, on the average, about 58 percent of the 
scheduled classes. 

Although the records showed that certain enrollees had 
completed vocational training, the OICs, except for Seattle 
and Oklahoma City, had not established standards for deter- 
mining enrollee progress in and completion of vocational 
training. The Oklahoma City OIC, although having such 
standards, did not always determine whether the enrollees 
had completed the training requirements. 

Also some OICs discontinued courses in certain skill 
areas because of low rates of enrollment, attendance, 
course completions, or training-related placements but con- 
tinued to offer courses in other skill areas under similar 
conditions . 

OICs could improve the vocational training component, 
could increase the benefits available to enrollees, and 
could provide for a more effective and efficient use of 
available resources by: 

— Reducing the absenteeism and dropout rates. 

— Establishing appropriate standards for completing 
training and measuring enrollee progress against 
such standards. 



— Periodically evaluating the appropriateness of con- 
tinuing to offer courses in each skill area. 

Vocational training design 

The vocational training component seeks to give job- 
entry-level skill training to unemployed, underemployed, 
and unmotivated disadvantaged persons. Enrollees in the 
component may be persons transferring from the prevocational 
training component or newly recruited persons bypassing the 
prevocational training component and enrolling directly 
into vocational training. Overall about 25 percent of the 
enrollees entering vocational training at the five OICs 
during the periods we reviewed were in the latter category. 

A variety of vocational training courses was offered 
by each OIC during both the day and evening. Courses were 
offered in specific skill areas generally on the basis of 
the needs of the community in terms of labor shortages. 

The instructors were generally college graduates or were 
experienced in the skill areas offered. Although the 
courses normally were scheduled for a specific length of 
time, the enrollees generally progressed at their own pace. 

The number of skill areas in which courses were of- 
fered during 1969 and early in 1970 ranged from six at the 
Milwaukee OIC to 26 at the Philadelphia OIC. The Seattle, 
Oklahoma City, and Dallas OICs offered 13, nine, and seven 
skill areas, respectively. Some OICs offered basic educa- 
tion, and all of them provided motivational and attitudinal. 
training to enrollees while they participated in vocational 
training. 

The skill areas included (1) clerical and sales occu- 
pations, such as typing and retail selling, (2) service oc- 
cupations, such as commercial cooking and restaurant- 
related practices, (3) processing occupations, such as 
power sewing, (4) machine trade occupations, such as auto- 
mobile mechanics and office machine repair, (5) benchwork 
occupations, such as those of electronics assembler and 
electronics technician, and (6) structural work occupations, 
such as welding, masonry, and carpentry. 
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The vocational courses appeared to be adequately de- 
signed and staffed. Although the available equipment was 
not always of the latest type being used in industry, it 
appeared to be adequate for training purposes. 

Overall results of 
vocational training component 

Our analyses at the five OICs of enrollee termination 
information in either the OIC records or a statistical 
sample of these records indicated that 4,630 enrollees had 
participated in, and had terminated from, the five OIC vo- 
cational training components during the 12-month periods 
covered by our review. On the basis of our analyses, we 
found that : 

— 1,440, or 31 percent, were considered to have com- 
pleted vocational training and had been placed in 
jobs. 

— 250, or 5 percent, were considered to have completed 
vocational training but had not been placed in jobs 
at the time they terminated from the program. 

— 30, or 1 percent, had transferred to other manpower 
. programs prior to completing training. 

— 40, or 1 percent, had been placed in jobs prior to 
completing training. 

— 2,870, or 62 percent, had dropped out of the OIC 
program during vocational training. 

Enrollee attendance and dropout rates 

Available records showed patterns of enrollee partici- 
pation in the vocational training component similar to 
those in the prevocational training component. For voca- 
tional training enrollees the average daily attendance rate 
was 58 percent and ranged from 45 percent at the Milwaukee 
OIC to 63 percent at the Seattle OIC. The dropout rate for. 
vocational training enrollees averaged 62 percent for the 
five OICs and ranged from 87 percent at the Milwaukee OIC 
to 40 percent at the Dallas OIC. 
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As in the prevocational training component, these per- 
centages are distorted, to some extent, by the OIC practice 
of retaining inactive enrollee,?. on program rolls for long 
periods before they are officially terminated. 

Absenteeism and termination prior to completion of 
training preclude many enrollees from fully developing 
their capabilities for work and social responsibilities. 
Dallas OIC officials informed us that family problems, 
transportation problems, and changes in work schedules of 
enrollees who were employed contributed to the absenteeism 
and dropout rates. 

Records at the Philadelphia OIC, which had a vocational 
training dropout rate of 58 percent, showed that the major 
reasons for enrollees' dropping out prior to completion of 
training were employment conflicts, illness, and disinterest. 
The OIC's records did not indicate that any in-depth analy- 
ses had been made of the reasons for absenteeism and drop- 
outs from the vocational training component or that specific 
efforts had been made to reduce the dropout rates, except 
for efforts similar to those discussed previously with re- 
spect to the prevocational training component. 

The Seattle OIC, however, had higher attendance and 
lower dropout rates for the vocational training component 
for the 6-month period ended June 30, 1970, than it had for 

1969. The vocational training attendance rate, which had 
been 63 percent in 1969, increased to 76 percent, and the 
dropout rate, which had been 73 percent in 1969, decreased 
to 66 percent. The payment of stipends and the practice of 
enrolling persons only after a 2-week orientation period, 
both of which were initiated by the Seattle OIC in January 

1970, probably contributed to these improvements. 

Enrollee progress and completion of training 

Standards to be used in measuring progress in and 
completion of vocational training were established by the 
Seattle and Oklahoma City OICs. The Seattle OIC and, in 
some cases, the Oklahoma City CIC tested enrollees periodi- 
cally to measure their achievements against such standards. 
The three other OICs did not develop such standards, so 
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they had no bench marks against which to measure enrollee 
progress and completion of training. 

Establishing and implementing appropriate standards 
for determining progress in and for completion, of vocational 
training would enable (1) the enrollee to be aware of his 
progress and of what he must accomplish to complete his 
training, (2) the employer to have a clear understanding of 
the training received by the enrollee, and (3) OICs to mea- 
sure the effectiveness of their training. 

We were informed by Dallas OIC officials that standards 
had not been established but that instructors evaluated en- 
rollee progress and job-readiness by testing or personal 
judgment. The Milwaukee and Philadelphia OICs did not pre- 
scribe standards and did not require formal testing of en- 
rollees. Rather, at the Philadelphia and Milwaukee OICs, 
counselors and instructors determined when an enrollee was 
job-ready. At the Milwaukee OIC such determinations often 
were made at the enrollee' s request rather than made sys- 
tematically. 

Evaluation of vocational courses 



Some OICs discontinued offering training in certain 
skill areas because of low enrollee interest and a low rate 
of training-related job placements. Our analyses of OIC 
training courses indicated that there was a need for 
periodic evaluation of all courses offered to determine 
whether continuing the courses was appropriate. Such an 
evaluation appeared to be warranted because of changing 
labor market requirements, job-placement opportunities, and 
enrollee interest. 

For example, our analysis of enrollment in the nine 
skill areas offered by the Oklahoma City OIC showed that: 

— Five skill areas, during a 6-month period in 1970, 
bad, on the average, eight or fewer enrollees in 
both the day and evening sessions. One ski7.1 area — 
office machine service — had only two enrollees, one 
during the day and one during the evening. 
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— Three skill areas — welding, machine tool operator, 
and motor mechanic — had a total of 94 enrollees who 
entered these skill areas during 1969 and terminated 
from the program prior to June 1970. Of these, 10 
were placed in training-related jobs. 

The Philadelphia OIC discontinued courses in two skill 
areas — computer maintenance and office machine repair — after 
only two enrollees trained in each skill were placed in jobs 
in 1969. A Philadelphia OIC official informed us that 
courses in these skill areas, each of which had been of- 
fered during both the day and evening, had been discontinued 
because (1) the length of the training period was too long, 
(2) a high level of education was required, (3) the training 
equipment was obsolete, (4) the enrollees showed a lack of 
interest, and (5) the training did not provide the skill 
level required on a job. 

The Philadelphia OIC's records showed that certain 
other skill areas being offered also had low enrollee in- 
terest and only limited success in job placement. For ex- 
ample, of the 22 remaining skill areas in which courses 
were offered during the day, 18 had utilization rates (the 
course capacity relative to enrollee attendance) during 
1969 of less than 60 percent, the rate recommended in the 
Philadelphia OIC's 1968 Management Information System re- 
port as a measure of satisfactory performance. Of the 20 
remaining skill areas in which courses were offered in the 
evening;! eight had utilization rates in 1969 of less than 
60 percent. 

(This criterion had been developed by the OIC's De- 
partment of Research and Evaluation but was not officially 
adopted by the OIC.) Also, for each of four of the skill 
areas which OIC continued to offer, seven or fewer job 
placements were made during 1969, as shown in the following 
table. 



^Some skill areas are offered both during the day and in 
the evening; others, only at one time or the other. 
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Number of enrollees 



Placed 



Skill area 


Terminating 
during 1969 


Training 

complete 


Training 

incomplete 


Total 


Brick masonry 
Building trades 


51 


6 


- 


6 


orientation 
Commercial cook- 


76 


7 




7 


ing 

Restaurant- 
related prac- 


22 




4 


4 


tices 


10 


— 


_2 


_2 


Total 


159 


13 


_6 


19 



At the Seattle OIC, which offered training to enrollees 
in the Concentrated Employment Program also, two skill 
areas — those for computer-programmer aides and sheet metal 
assembler- installers — were phased out in 1969. The first 
was phased out as a result of an industry study which had 
shown a low demand for persons trained for such jobs, and 
the second because of low enrollee interest. Evaluation of 
additional courses, however, appeared to be needed. 

For example, of the 95 OIC and Concentrated Employment 
Program enrollees who terminated from the Seattle OIC's 
basic electronics course during the 18-month period ended 
June 30, 1970, only seven had completed training. Of the 
seven who had completed training, five — three OIC and two 
Concentrated Employment Program enrollees — were placed in 
jobs. The three OIC enrollees reportedly were placed in 
non-training-related jobs. Information was not available 
at the OIC as to whether the jobs in which the Concentrated 
Employment Program enrollees had been placed were training 
related. 

The Dallas OIC discontinued the teletype operator 
course and replaced it with a check-proofing-machine- 
operator course when proofing machines were donated by a 
local bank. Also the Milwaukee OIC discontinued its course 
for training cashier-checkers. We did not find any indica- 
tion, however, that these OICs had established systematic 
procedures for evaluating the other skill areas they offered 



from the standpoint of enrollee interest and training- 
related placements, to determine the appropriateness of 
continuing the skill training. 

Conclusions 



During the 12-month periods covered by our review, the 
five OICs prepared about 1,700 enrollees for jobs through 
their vocational training components. Other enrollees, who 
had not completed vocational training, undoubtedly received 
some benefits from their participation in the OIC program. 

Weaknesses in the vocational training components, how- 
ever, particularly absenteeism and at three OICs a lack of 
standards against which to measure enrollee progress and 
training completion, raise some question as to whether en- 
rollees, classified by OICs as having completed the pro- 
gram, possessed the knowledge and job-entry-level skills 
required for satisfactory job performance. 

Classifying an enrollee as having completed the pro- 
gram, without having appropriate standards to aid in such 
determinations, initially may increase the enrollee' s 
chance to obtain employment; but it may increase also the 
possibility of his losing the job obtained because of an 
inability to perform satisfactorily and it may have an ad- 
verse effect on attempts to place future program enrollees 
with the employers involved. 

Appropriate criteria for determining progress in and 
for completion of vocational training would encourage im- 
proved training and provide OICs with information to mea- 
sure their performance and employers with assurance that 
the enrollees, classified as having completed the program, 
possessed the minimum requisites for the skills in which 
they were trained. 

Further, as noted previously in regard to the prevoca- 
tional training component, the inability of OICs to retain 
enrollees long enough to assist them in developing the habit 
of regular attendance, normally a basic job requirement, 
and to enable them in acquiring adequate knowledge and 
skills necessary to obtain and hold jobs is a significant 



problem, the basic causes of which OICs should seek to 
identify and minimize. 

Moreover, although some OICs have discontinued offer- 
ing courses in certain skill areas, additional evaluations 
appear to be warranted to determine whether other skill 
areas should be continued. Continuing to offer braining 
in skill areas in which there is low enrollee interest or 
limited job opportunity is questionable not only from the 
standpoint of effective and efficient use of available re- 
sources but also from the standpoint of continued enrollee 
confidence in OIC ability to provide marketable skills. 

Recommendations to the Secretaries of Labor 

and of Health, Education, and Welfare 

and to the Director, Office of Economic Opportunity 

We recommend that the three Federal agencies require 
and assist OICs to 

--establish standards for measuring enrollee progress 
in and completion of vocational training courses, 
possibly on a programwide basis, and periodically 
evaluate such standards and 

— periodically evaluate — on the basis of enrollee in- 
terest, job opportunities, and the most effective 
and efficient use of available skill- training re- 
sources — the appropriateness of continuing to offer 
training in each skill area. 



In commenting on our first recommendation, OEO ad- 
vised us that its monitoring of OICs indicated that some 
standards for measuring vocational training progress al- 
ready existed. OEO agreed, however, that a more systematic 
approach to evaluating enrollee progress would be beneficial. 
OEO believed that standards should, of course, have flexi- 
bility so that the program emphasis would continue to be on 
the program enrollee. 

Regarding our second recommendation, OEO agreed that 
periodic evaluation of the need for the types of skill 
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training offered by OICs in a particular area was necessary 
to ensure that the labor market could respond to the 
trained enrollees. 

In concurring in our recommendations, HEW stated that 
it was making plans to experiment with the Institute in the 
area of skill demonstration or performance testing as op- 
posed to regular achievement or academic testing. In addi- 
tion, HEW expected the single-contract concept to provide 
standards and uniformity. 

Labor advised us that procedures were being formulated 
for measuring and evaluating enrollee progress toward com- 
pletion of vocational training. In addition, Labor stated 
that the appropriateness of continuing certain vocational 
training courses was being evaluated. 



JOB-PLACEMENT RECORDS AND REPORTS 



Oar review at the five OICs of job-placement records 
and reports to the Institute showed that the records had not 
always been complete or accurate and that they had not al- 
ways been consistently maintained. Our review showed also 
that the number of job placements reported by OICs had, in 
many cases, been overstated or could not be documented. 

Also we found that the records did not always show the 
amount of OIC training provided or the nature of the jobs 
obtained by the enrollees reported as placed. 

Further, early in 1970, when we asked the employers 
named in OIC records about the job status of a sample^ of 
824 OIC enrollees reported as having been placed with them 
during calendar year 1969, responses received for 495 of the 
enrollees revealed that, for about 14 percent of the enrol- 
lees, employers had no record of the enrollees * ever having 
been employed by them. 

More accurate, complete, and consistent classification 
and recording of job-placement and job-retention information 
would enable OICs to better assess the effectiveness of their 
programs and ensure more reliable and informative reporting 
of program accomplishments. 

The five OICs reported to the Institute a total of 
3,688 job placements during calendar year 1969. Our review 
of OIC records, however, showed that they had placed a total 
of 1,733 enrollees in full-time jobs during that year — 1,441. 
who were considered to have completed training and 292 who 
had not completed training. 

The Institute included the number of job placements 
reported by the five OICs — 3,688 — together with those of all 
other OICs, in its March 1970 report to the three Federal 
agencies. The number of job placements reported by the In- 
stitute for calendar year 1969 was introduced in hearings 
held in March 1970 by the Subcommittee on Employment, Man- 
power, and Poverty of the Committee on Labor and Public 




See ch. 5 for information 
selection at each OIC. 



on sample size and method of 




Welfare, United States Senate. The Committee included the 
Institute's figures in its report on the proposed Employment 
and Training Opportunities Act of 1970 (S. Rept. 91-1136, 
August 20, 1970). 

We asked each of the five OICs for documentation sup- 
porting its job placements for calendar year 1969, Lut only 
one — Philadelphia — provided us with information showing how 
it had computed the placements reported to the Institute. 

The placement information provided to us by the other OICs 
did not agree with the placement information that they had 
reported to the Institute. 

Our review and analysis of each OIC's job-placement 
records, including those made available to us by the Phila- 
delphia OIC, showed that generally the records had not been 
complete or accurate and that they had not been consistently 
maintained. In many cases, persons reported as having been 
placed in jobs had not received any OIC training and other 
persons had attended OIC training sessions, or had received 
supportive services under OIC subcontracts while they were 
enrolled in other training programs or were already employed. 
In some cases, the same person was reported as having been 
placed more than once, the same placement was reported more 
than once, or temporary or part-time jobs held by enrollees 
during training to enable them to continue in the OIC pro- 
gram were recorded as placements. Also our attempts to ob- 
tain information on the job status of enrollees reported as 
placed revealed that , in some cases , they never had been 
employed by the employers named in OIC records. 

The following examples illustrate the above observa- 
tions. 



1. Information made available to us by the Philadelphia 
OIC showed that, of its reported 2,085 job placements for 
calendar year 1969, only half — 998 — had been enrolled in the 
OIC program and had been provided with vocational training 
at the OIC. The remainder were almost evenly divided be- 
tween prevocational training enrollees who had been provided 
with temporary or part-time jobs to enable them to continue 
their OIC training and persons who had been provided with 
training at the OIC but who were enrolled in programs other 
than the OIC training program. 
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In reviewing the OIC placement records on the 998 re- 
ported vocational training placements, we identified 58 per- 
sons who were reported as having been placed more than once 
and who accounted for 125 placements; 23 persons who, ac- 
cording to the records, did not receive OIC training; and 
228 persons who were placed in special training projects 
sponsored by local business, for which the OIC provided 
training or supportive services. We also inquired of the 
employers named in the OIC's records about the job status 
of 347 enrollees who were reported as calendar year 1969 
vocational training placements. We were informed that, of 
the 212 enrollees for whom we received responses, 13 had 
not been employed by these employers. 

2. The Milwaukee OIC's records showed that, of its 231 
reported placements for calendar year 1969, nearly half 
were persons who had come to the OIC looking for jobs and 
had been placed directly without receiving any training at 
the OIC. Our further analysis of the records and our in- 
quiries of the named employers on the 144 placements re- 
ported for the 7-month period March through September 1969 
showed that six persons were reported erroneously as having 
been placed in jobs, that 13 had been hired but had not 
started work, that 77 had been placed directly, and that, of 
the 48 remaining persons who had received some OIC training, 
only 13 were considered by the OIC to have completed train- 
ing. 

3. The Institute's March 1970 report to the three Fed- 
eral agencies showed 603 job placements for the Seattle OIC 
for calendar year 1969. The OIC's records, however, showed 
only 307 full-time job placements and 159 placements of en- 
rollees in temporary or part-time jobs during training. 

Our analysis of the records on the full-time job placements 
showed that, after eliminating placements that had been re- 
ported more than once, multiple placements for the same en- 
rollees, and placements in prior years, the OIC actually 
had placed 249 of its enrollees in full-time jobs during 
1969, of whom 145 were considered to have completed training. 

C onclusion 

Because the primary objective of the OIC program is to 
train persons to obtain and hold jobs, it is important that 
job-placement information be recorded accurately, be 



54 



59 



reported consistently, and include a clear record of OIC 
training provided and the nature of the job, so that the 
effectiveness of the OIC program can be evaluated. 

Because OIC job-placement information has not always been 
accurate and complete, a realistic relationship between job- 
placement experience and OIC training has not been available. 

Recommendation to the Secretaries of Labor 

and of Health, Education, and Welfare 

and to the Director, Office of Economic Opportunity 

We recommend that the three Federal agencies require 
and assist OICs to maintain adequate records of enrollee 
termination information and to develop a reporting system 
which will provide OICs with appropriate information on job 
placements. 



0E0 concurred in our recommendation, as did HEW. HEW 
commented that, although job placement was a specific respon- 
sibility of the U.S. Employment Service component of the OIC 
contract, the Area Manpower Institutes for the Development 
of Staff Centers was assisting the Service in this effort 
and that HEW was sharing with the Service the pertinent ex- 
perience gained in administering manpower skill centers. 

Labor stated that a central records system had been im- 
plemented in all local OIC programs. Labor said that it was 
requiring, and through the Institute was assisting, OICs to 
maintain adequate records covering all aspects of enrollee 
activities from the initial recruitment through postplacement 
follow-up. 
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JOB- DEVELOPMENT ACTIVITIES 



The Milwaukee OIC was expending little effort on job 
development at the time of our review because so few en- 
rollees had completed training under its program. The job- 
development activities of the other four OICs generally 
were adequate in finding job openings to which enrollees 
who were considered to have completed training could be re- 
ferred. 

Each OIC had a job-development staff responsible for 
determining the skills needed by employers in the local 
areas and the employment opportunities available to OIC en- 
rollees and for making the employers aware of the OIC pro- 
gram and the availability of OIC enrollees. OICs used a 
variety of direct and indirect approaches to identify or 
develop employment opportunities; the most prevalent method 
was personal contacts with potential employers. 

In addition to maintaining personal contacts, the 
Seattle OIC--which concentrated its efforts on finding 
training- related jobs having chances for advancement — relied 
on labor forecasts, was on the mailing lists for publica- 
tions of employment opportunities in the area, end main- 
tained liaison with other job-finding agencies. Oklahoma 
City OIC officials frequently spoke at civic and church 
functions in efforts to reach potential employers and in- 
vited potential employers to tour the OIC and to learn 
about the employment potential available. 

The effectiveness of OIC job- development efforts in 
finding jobs for program enrollees can be judged, to some 
extent, by the fact that, during the periods covered by our 
review, about 85 percent of the enrollees who were con- 
sidered to have completed the program were placed in full- 
time jobs. 

FOLLOW-UP ON ENROLLEES PLACED IN JOBS 



Each OIC made some follow-up contacts with former en- 
rollees who had been placed in jobs or with their employers, 
to identify problems or additional supportive services 
needed by the enrollees in meeting employment requirements 

and to ob train information needed to evaluate program 




effectiveness. The contacts generally were not being made 
in the manner and to the extent called for in agreements 
with the three Federal agencies. Also the contacts that 
were made, which generally were made with employers, were 
not always timely or adequately documented. OICs made 
little — or, in the case of the Seattle and Milwaukee OICs, 
no — effort to follow up on those enrollees who had left the 
jobs in which they initially had been placed. 

As a result not all former OIC enrollees were being 
given the assistance necessary to enable them to retain 
stable employment. Also OICs were not obtaining information 
needed to evaluate the effectiveness of their programs. 

The best test of the effectiveness of a job-training 
program is whether a person can hold a job after he has 
been hired. Therefore the Federal- agency funding agreements 
require that OICs follow up on enrollees referred to or 
placed in jobs, to provide them with any additional assis- 
tance needed to retain stable employment and to secure in- 
formation to evaluate the effectiveness of the OIC program. 

The agreements generally provide for follow-up con- 
tacts to be made with former enrollees shortly after their 
placement in jobs and on a regular basis thereafter at peri- 
ods of 3 months to more than a year and for follow-up con- 
tacts to be made with the enrollees' employers as necessary. 

Except for contacts with employers made by the Seattle 
OIC and contacts with the enrollees made by the Oklahoma 
City OIC, however, follow-up contacts were not being made 
on a regular basis. The Philadelphia OIC generally con- 
tacted employers shortly after enrollees had been nlaced 
in jobs to confirm that they had reported to the jobs but 
made only limited contacts thereafter with either the 
former enrollees or the employers to follow up on job per- . 
formance or to assist the enrollees in solving personal or 
job-related problems. 

A Dallas OIC official informed us that they had made 
some follow-up contacts, but not on a regularly scheduled 
basis; that responsibility within the OIC for follow-up had 
changed several times during the period of our review; and 
that documentation on follow-up contacts had not been 
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maintained in an orderly manner. A Seattle OIC official 
informed us that formal efforts had not been made to con- 
tact former enrollees who were working and that follow-up 
records had not been maintained prior to 1969. Also we were 
informed by OIC officials that the Seattle and Milwaukee 
OICs had made no efforts, and that the three other OICs had 
made only limited efforts, to contact former enrollees who 
had left their initial jobs. 

At the Milwaukee OIC our analysis of follow-up records 
for 47 enrollees reported as being placed in jobs during 
July, August, and September 1969 — follow-up records had not 
been maintained prior to July 1969- -showed that, on the 
average, 21 days elapsed from the date of placement to the 
date of the first recorded follow-up contact with either 
the former enrollee or his employer. Of the 47 enrollees, 

15 left their jobs prior to the first recorded contacts and 
thereby negated any effect the contacts might have had in 
aiding them to adjust to and maintain employment. 

Our inquiries of the employers named in OIC records of 
495 enrollees reported as placed during 1969 (see app.il) 
showed that, at the time of the employers' responses, 227 
enrollees still were employed, 67 had not been listed in the 
employers' records as having been employed, and 201 who had 
been employed no longer were employed. In our opinion, the 
failure of significant numbers of enrollees to report for 
work or to remain employed indicates that many enrollees re- 
ferred to or placed in jobs were in need of follow-up assis- 
tance. Even in situations in which enrollees were laid off 
because of economic conditions, follow-up assistance would 
have been helpful. 

OIC officials generally acknowledged that there was a 
need for improved follow-up with enrollees who had been re- 
ferred to jobs or who had been placed in jobs and with their . 
employers. They informed us that their follow-up activities 
had not been as complete or effective as they might have 
been because of such factors as insufficient funds, limited 
staff, continuing changes in the organizational components 
responsible for follow-up, and the failure of former en- 
rollees to notify OICs when employment problems were en- 
countered. 
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Conclusions 



OICs needed to improve their follow-up with former en- 
rollees who had been referred to or who had been placed in 
jobs and with their employers to ensure that the enrollees 
are provided with all assistance necessary to enable them 
to obtain and retain stable employment. Such follow-up is 
necessary to obtain information for evaluating program ef- 
fectiveness. Follow-up contacts should be made on a reg- 
ular basis, and follow-up assistance should be available to 
former enrollees until they are fully self-reliant. 

We recognize that improved follow-up procedures would 
add to the program's costs. We believe, however, that, be- 
cause OICs generally have invested substantial resources in 
bringing enrollees to a job-ready status, the added costs 
to ensure job retention would be worthwhile. 

Adequate documentation of follow-up contacts would 
facilitate continuity of follow-up services when there is a 
turnover of follow-up employees or when responsibility for 
follow-up is reassigned. Information obtained from follow- 
up contacts would assist in evaluating the programs' effec- 
tiveness in helping enrollees to obtain and retain employ- 
ment and would help to identify and correct weaknesses in 
OIC training and job-placement activities. 

Agency actions 

In a draft report we proposed that the Secretaries of 
Labor and of Health, Education, and Welfare and the Director 
of the Office of Economic Opportunity enforce the require- 
ment that OICs make regular follow-up contacts with former 
enrollees who had been referred to jobs or who had been 
placed in jobs and with their employers and that OICs main- 
tain adequate documentation of such contacts. 

In concurring in our proposal, OEO stated that, in a 
recent evaluation report on OICs (dated November 13, 1970), 
OEO had recommended that OICs develop longer periods of 
follow-up on former enrollees. OEO stated also that OICs 
had informed OEO that the recommendation had been implemented,. 
The follow-up period was extended to 1 year after referral 
or placement. HEW also concurred in our proposal. 



labor stated that, through the Institute, all OICs are 
required to have established follow-up capabilities. Labor 
stated also that records are being maintained to include 
the number of enrollees placed in jobs and backup informa- 
tion — names, placements, dates, skill areas completed, and 
follow-up for 1 year after placement. 



CHAPTER 4 



IMPROVEMENTS HEEDED IN PROGRAM MANAGEMENT 

Improved monitoring and evaluation of OICs by the 
three Federal agencies or by their contractors, accumula- 
tion of better operational data, and a change in the funding 
arrangements of OICs were needed to improve program manage- 
ment at all levels. The three Federal agencies, the Insti- 
tute, and the OICs made some efforts to bring about the 
needed improvements, and further actions are being planned. 
The improvements needed and the actions taken or planned 
to effect the improvements are discussed in the following 
sections of this chapter. 

MONITORING AND EVALUATION EFFORTS AND PROGRAM DATA 

OIC operations were monitored and evaluated in varying 
degrees directly by the Federal, State, local, and other 
agencies involved in the OIC program. For some OICs out- 
side contractors were hired by community action agencies 
or by the Federal agencies to make special evaluations, and 
each of the OICs was audited regularly by a public account- 
ing firm. 

The monitoring and evaluation efforts would be more 
effective, however, if (l) they were made on a more system- 
atic basis and responsibility for them was defined more 
clearly, (2) an assessment of program effectiveness and 
compliance with contractual requirements were included, 
and (3) prompt actions were taken to implement needed im- 
provements. Also officials of OICs and of the participating 
Federal agencies needed better operational data than was 
available, to more effectively manage the OIC program and 
to monitor and evaluate its progress. 

Systematic and in-depth monitoring and evaluations 
provide means for assessing progress in achieving program 
objectives and for identifying improvements, changes in 
program emphasis, and technical assistance that may be 
needed. To ensure coverage of all major program aspects 
and to enable assessment of program progress, monitoring 
and evaluation efforts must be adequately planned and re- 
sponsibility for them clearly defined, standards must be 



o 

ERIC 



61 



66 



established against which progress can be measured, and ade- 
quate operational data must be available. To ensure prompt 
implementation of needed improvements, the responsibility 
for, and the authority to direct, corrective action should 
be clearly delineated and effectively exercised. 

Monitoring and evaluation 

Monitoring and evaluation of OIC activities were done 
or were arranged for during the period of our review by the 
local community action agencies, the Institute, the partici- 
pating State agencies, and the three Federal agencies. The 
extent of monitoring and evaluation ranged from continuous 
on-going monitoring of the Dallas OIC by the State employ- 
ment commission and the local community action agency, to 
periodic visits by Institute staff to each OIC, except the 
Philadelphia OIC, and to sporadic and infrequent monitoring 
and evaluation by the three Federal agencies. For example, 
as of July 1970, HEW and Labor representatives had not 
evaluated the Seattle OIC program after its inception in 
1966 and 0E0 had not evaluated the Philadelphia OIC after 
1967, when a management consulting firm under an 0E0 con- 
tract made a pilot study of the OIC's program. 

The three Federal agencies relied, for the most part, 
on the Institute and the State and local agencies through 
which OICs were funded to monitor and evaluate OIC activi- 
ties. The monitoring and evaluation efforts, however, were 
not coordinated effectively; the duties and responsibilities 
of those persons monitoring and evaluating the program and 
the standards they were to use to measure progress were 
not always defined clearly or were defined too loosely; 
some aspects of OIC activities were not reviewed; and the 
authority to direct and the responsibility to implement 
needed improvements were not always delineated or exercised. 

According to the contracts, when corrective actions 
are recommended by the Institute, the authority to direct 
that these changes be made is retained by the three Federal 
agencies. At the time of our review, however, these agen- 
cies apparently had not taken much action to see that im- 
provements recommended by the Institute were implemented. 
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As a result, such program aspects as the progress 
made in training and placing the desired number of persons 
in jobs or in reaching the intended target population were 
not always reviewed by the three Federal agencies; the 
reasonableness of program costs was not always reviewed by 
the three Federal agencies; although problem areas were re- 
ported to the three Federal agencies, the causes of the 
problems were not always identified; monitoring and evalua- 
tion efforts were sporadic; and the same management weak- 
nesses or problem areas for the same OICs were reported 
repeatedly to the three Federal agencies with no apparent 
action being taken to direct or implement needed improve- 
ments. 

Operational data 

Better operational data was needed for monitoring and 
evaluation purposes and for program management. In August 
1969 a management information system, designed specifically 
for OICs but patterned after Labor's overall manpower in- 
formation system, was adopted. This system was intended to 
serve the information requirements of OICs and to provide 
reliable operational data for monitoring and funding deci- 
sions by the Federal agencies and for comparison of OIC 
program results with the results of other Federal manpower 
programs . 

Although we. noted some improvement in the amount and 
type of data developed by OICs under this system over that 
developed previously, the data still was not consistent, 
complete, or reliable. The inconsistency in the data re- 
sulted because such decisions as when a person was to be 
considered enrolled in or terminated from the program were 
made by each OIC. The Milwaukee OIC, for example, had 
several policies for determining when a person would be 
considered as entered in the program but had no criteria 
for determining when a person should be considered as no 
longer in the program. 

The data was incomplete because the system did not 
adequately provide for accumulating and reporting such infor- 
mation as: (1) educational progress of enrollees, (2) ca- 

pacity of and average enrollment in prevocational and voca- 
tional courses, (3) type of job placement, training-related 
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or non- training-related, (4) supportive services provided 
to enrollees, (5) statistics on program results in relation 
to program goals, and (6) characteristics of enrollees as 
between day and evening courses. 

Moreover, the data was not always accumulated and re- 
corded systematically by OICs and, as discussed in this re- 
port, OIC records frequently were inaccurate or incomplete. 
For example, the Milwaukee OIC reported an enrollment of 
649 enrollees as of February 28, 1970; our analysis of the 
OIC's records, however, showed the enrollment at that time 
to be 417. 

We were informed by a Labor official in October 1970 
that the information system needed improvement and that ef- 
forts would be made to correct the deficiencies. He stated 
that the data obtained from the system by Labor, which acts 
as the focal point for the system at the Federal level, was 
not being disseminated to 0E0 and HEW basically because of 
the unreliability of the data. In April 1971 we were in- 
formed by a Labor official that the management information 
system was under going revision. 

Conclusions 



The operations of OICs should be monitored and evalu- 
ated systematically and in depth, to enable those respon- 
sible for management decisions to determine the effective- 
ness of OICs in achieving program objectives and to deter- 
mine the improvements, changes in program emphasis, and 
technical assistance that may be needed. The monitoring 
and evaluation efforts should be adequately planned and re- 
sponsibilities of the various agencies involved in the OIC 
program shot Id be clearly defined so that the most effi- 
cient methods of monitoring and evaluating can be used and 
so that prompt and appropriate action can be taken on rec- 
ommended improvements. 

The OIC management information system needs consider- 
able improvement, and OICs need to maintain more accurate 
and complete records if consistent, complete, and reliable 
operational data is to be available for monitoring and 
evaluation purposes and for program management decisions. 
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Recommendations to the Secretaries of Labor 

and of Health, Education, and Welfare 

and to the Director, Office of Economic Opportunity 

We recommend that the three Federal agencies develop a 
monitoring and evaluation plan which will 

— define the responsibility for, and the timing and 
degree of, monitoring and evaluation efforts, 

— establish standards against which program progress 
can be measured, and 

— fix responsibility for ensuring that prompt and ap- 
propriate actions are taken on recommendations for 
improvements . 

We recommend also that the Federal funding agencies 
review the design of the OIC management information system 
and OIC recordkeeping procedures and practices with a view 
toward improving the reliability and usefulness of opera- 
tional data needed for monitoring and evaluation purposes 
and for effective program management. 




0E0 indicated that, in the light of the OEO transfer 
of its OIC responsibilities to labor effective July 1, 1971, 
OEO regarded Labor as a lead agency in regard to a definite 
monitoring and evaluation plan designed to comply with the 
recommendation but that OEO would assist Labor where appro- 
priate. 

OEO stated that its recent evaluation of the technical 
assistance provided by the Institute indicated that, over- 
all, OIC was a quality manpower training program. OEO fore- 
saw that the single-agency- funding arrangement would elimi- 
nate many of the present problems. 

HEW concurred in our recommendations and stated that 
HEW, through the Area Manpower Institutes for the Develop- 
ment of Staff Centers, was providing technical assistance 
to OICs, to improve the management information system and 
recordkeeping procedures. HEW, however, expressed its 
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willingness to join with Labor and 0E0 in developing a mon- 
itoring and evaluation plan. 

Labor advised us that OICs were being monitored and 
evaluated regularly through a plan developed by the Insti- 
tute in conjunction with Labor. Labor indicated that the 
plan defined the responsibility for the timing and degree 
of monitoring and evaluation, established standards against 
which program progress could be measured, and fixed respon- 
sibility. Labor indicated also that it planned to initiate 
during calendar year 1972 an overall evaluation of OICs to 
assess the degree to which the OIC program achieved the 
stated objectives. 
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SINGLE- SOURCE FEDERAL FUNDING 



Under 1971 agreements among the three Federal agencies 
and the Institute, the funding arrangements of OICs have 
changed since the period of our review. The contract pro- 
vides for Federal funds to be channeled through Labor to 
the Institute. The Institute is the prime contractor prin- 
cipally responsible to Labor for the performance, monitor- 
ing, and evaluation of all local OICs, which are subcon- 
tractors under the contract. Effective implementation of 
the changes specified in the contract should reduce the ad- 
ministrative work loads of both OICs and the Federal agen- 
cies. 




According to an 0E0 official, pilot tests seeking a 
better method of funding OICs were undertaken by the Federal 
agencies in August 1970 and were scheduled to cover a 1-year 
period, after which results were to be evaluated. As of 
January 1972 the tests had not been evaluated. The proposed 
Employment and Manpower Act of 1970, which was vetoed by 
the President in December 1970, would have centralized in 
Labor the Federal responsibility for funding and administer- 
ing the OIC program. Also legislation introduced in 1971 
called for the centralization of responsibility for the OIC 
program in Labor. 

OICs included in our review were provided with their . 
program funds by the three Federal agencies and by State 
and local agencies in the form of grants, cost- reimbursement 
contracts, or contributions. 0E0 and Labor funds were used 
primarily for the prevocational training component and ad- 
ministrative expenses; HEW funds were used for the voca- 
tional training component. 0E0 and Labor generally funded 
OICs on an advanced- funding basis through grants to the lo- 
cal community action agencies, and HEW either contracted 
directly with OICs or provided funding through State voca- 
tional training agencies on a reimbursement basis. 

These funding arrangements that were in effect during 
our review created an administrative burden for OICs be- 
cause of different application procedures and forms, dif- 
ferent policies and reporting requirements, various funding 
periods for different program components, and the need for 
separate recordkeeping to account for the funds. We were 
informed by an Institute representative that the OIC 
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prevocational and vocational training components sometimes 
operated as separate entities and that there was little 
coordination between them because they were funded by dif- 
ferent agencies. Each of the Federal agencies established 
administrative procedures to carry out its responsibilities, 
and no one agency had responsibility for approving and mon- 
itoring the entire OIC program. 

Some of the problems encountered by OICs because of the 
various funding arrangements are discussed, as follows: 

1. For example, at the Oklahoma City OIC, numerous 
bookkeeping adjustments had to be made to keep the records 
for each Federal funding agency in agreement with the OIC 
fund balance. Likewise, at the Milwaukee OIC, costs that 
were not directly chargeable to a particular Federal agency 

0 were allocated and charged arbitrarily against the funds 
provided by each agency. 

2. Payroll expenses for each OIC were to be shown as 
personnel costs on 0E0 and Labor reports but as instructional 
services on HEW reports. Travel expenses were to be shown 

as such on 0E0 and Labor reports but as local supervision 
costs on HEW reports. 

3. Morale problems were created at the Dallas OIC be- 
cause employee salaries and annual leave schedules approved 
for the prevocational training component funded by Labor and 
0E0 differed from those approved for the vocational training 
component funded by HEW although the job responsibilities 
were similar. 

4. Although 0E0 and Labor provided advance funding, HEW 
funds for the Dallas OIC were channeled through the State 
education agency, which was precluded by State law from pro- 
viding advance funding to training institutions, such as 
OIC. As a result, the Dallas OIC had funds available to pay 
prevocational training and administrative expenses but it 
incurred estimated interest expenses of $11, 000 on bank loans 
to carry out its vocational training component over a 2-year 
period. 
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Conclusion 



Funding OICs by or through a single Federal agency, if 
effectively implemented, should simplify accounting and re- 
porting requirements, should eliminate many of the financial 
and operational problems encountered by OICs and the three 
Federal agencies, and should result in a more efficient op- 
eration. 

The administration of OICs at the Federal level con- 
tinues to be vested in the three Federal agencies in vary- 
ing degrees. Labor, acting as the lead agency, is to keep 
HEW and 0E0 apprised of OIC program policy changes and gen- 
erally the results of its monitoring and evaluation func- 
tions. The 1971 agreements provide for (1) HEW to maintain 
its statutory responsibility, particularly that for institu- 
tional training activities, and (2) 0E0 to be involved as 
Labor carries out its evaluation and monitoring functions 
and to retain authority to evaluate overall program effec- 
tiveness and impact to ensure that the criteria for low- 
income participants are being met. 

Thus there is a need to modify the proliferation of 
responsibility for administration at the Federal- agency 
level. The duplication or overlapping caused by this pro- 
liferation can be counterproductive and may diminish the 
benefits that would be achieved through the single-source 
Federal funding. 

Matter for consideration by the Congress 

Although single-source Federal funding, in effect, has 
been achieved administratively by the three Federal agencies 
the Congress, in its deliberations on centralizing at the 
Federal- agency level the responsibility for the administra- 
tion of the OIC program, may wish to consider the administra 
tive problems of divided responsibility which remain and 
which are discussed above. 
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CHAPTER 5 




SCOPE OF REVIEW 

Our review of OICs in Philadelphia, Milwaukee, Dallas, 
Oklahoma City, and Seattle was directed toward examining 
into program results, the efficiency of OIC administration, 
and the discharge by the three Federal agencies of their 
responsibilities relative to OICs* We reviewed applicable 
legislation, policies, program documents, reports, corre- 
spondence, and other pertinent records and interviewed 
officials at OICs, the Institute, and the local community 
action agencies concerning activities during 1969 and 1970. 

We reviewed also records and reports and interviewed 
officials at the headquarters office and pertinent regional 
offices of 0E0, Labor, and HEW and at the State offices 
involved in the funding or administration of OICs. We also 
visited an OIC in Wilmington, Delaware, that was not fed- 
erally funded. In addition, we interviewed current enrollees 
and former enrollees and their employers to obtain their 
views and comments on the OIC program and the training 
received by the enrollees . 

We selected samples of enrollees at each OIC to obtain 
information about the enrollees and the OIC program. The 
samples selected and the purposes of each are, as follows: 

Philadelphia — From a universe of 3,914 enrollees 
who terminated from the OIC during calendar year 
1969, we randomly selected 329 enrollees and re- 
viewed available related records to determine 
their personal characteristics, the services 
provided to them, and the extent of their partici- 
pation. 

To obtain information on enrollees reported to 
have been employed and on their employment ex- 
perience, we mailed questionnaires to the 168 
employers who were shown in the OIC's records 
to have hired the 347 enrollees reported as 
placed in jobs from vocational training during 
the months of February, May, September, and 
November 1969. Responses were received from 
employers of 212 enrollees. 
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Milwaukee — From a universe of 897 persons who 
enrolled in the OIC during the 7 -month period 
March through September 1969, we selected a 
random sample of 135 enrollees to analyze their 
personal characteristics, their program partici- 
pation, and the services provided to them. To 
analyze employment experience we reviewed available 
information on all 144 enrollees reported as placed 
in jobs during this 7 -month period and submitted 
questionnaires to, and received responses from, 
the employers of 138 of the enrollees. 

Dallas — From a universe of 1,514 enrollees who 
terminated from the program during calendar year 
1969, we randomly selected a sample of 150 and re- 
viewed available related records to determine their 
personal characteristics, their program participation, 
and the services provided to them. For job-placement 
and job-retention information, we selected 152 en- 
rollees that had been reported as placed during calen- 
dar year 1969 — 24 were in the above sample of 150 — 
and mailed questionnaires to the named employers of 
143 of the enrollees whose records showed that they 
had been placed and for whom the employers' names and 
addresses were available. Responses were received 
from employers of 109 enrollees. 

Oklahoma City — To determine personal characteris- 
tics we selected for review 121 enrollees who 
entered the OIC during October 1969. To determine 
program participation, services provided, and employ- 
ment experience, we selected at random 102 of the 
624 enrollees that OIC reported as having been 
placed in jobs during 1969 and 122 of the 992 
enrollees reported as having left the program 
during 1969 prior to completing training or being 
placed. We submitted questionnaires to the re- 
ported employers of 102 randomly selected enrollees 
claimed to have been placed. Responses were 
received from employers of 101 enrollees. 

Seattle — Our analysis of personal characteristics 
and program participation and services was based 
on a random selection of 148 of the 2,171 enrollees 
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who had terminated from the program during 1969. 
To determine employment experience, we selected 
for review 94 of the 249 enrollees reported as 
placed in full-time jobs during 1969 and mailed 
questionnaires to their reported employers. Re- 
sponses were received from employers of 89 en- 
rollees. 
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APPENDIX I 



LIST OF OICS AS OF JULY 31, 1971 
TR I -AGENCY- FUNDED OICS 



Camden, New Jersey 
Cincinnati, Ohio 
Dallas, Texas 
Erie, Pennsylvania 
Harrisburg, Pennsylvania 
Jacksonville, Florida 
Little Rock, Arkansas 
Menlo Park, California 



Milwaukee, Wisconsin 
Minneapolis, Minnesota 
Oklahoma City, Oklahoma 
Omaha , Nebraska ' 
Philadelphia, Pennsylvania 
Roanoke, Virginia 
Seattle, Washington 



QIC- NATIONAL- INSTITUTE- FUNDED OICS 



Champaign, Illinois 
Charleston, West Virginia (note a) 
Charlotte, North Carolina 
‘Charlottesville, Virginia 
Chicago, Illinois 
Cleveland, Ohio 
Dayton, Ohio 
Denver, Colorado 
East Bay, California 
Fort Lauderdale, Florida 
Hudson Valley, New York 
Huntington, West Virginia 
Knoxville, Tennessee 
Lehigh Valley, Pennsylvania 
Long Beach, California 
Louisville, Kentucky 
Lubbock, Texas 
Mansfield, Ohio 
McKeesport, Pennsylvania 
Miami , Florida 
Montgomery, Alabama 



New Haven, Connecticut 
New London, Connecticut 
New York (Bronx) 

New York (Brooklyn) (note a) 

Norristown, Pennsylvania 

Oklahoma City, Oklahoma (model) (note b) 

Philadelphia, Pennsylvania (model) (note b) 

Phoenix, Arizona 

Pittsburgh, Pennsylvania 

Portland, Oregon 

Providence, Rhode Island 

Rockford, Illinois 

Rocky Mount, North Carolina 

Saginaw, Michigan 

San Francisco, California 

San Jose, California 

Stockton, California 

Washington, D.C. (note a) 

Washington, D.C. (model) (note b) 
Wilmington, Delaware 
Yakima , Washington 



OTHER-GOVERNMENT-FUNDED OICS 



Atlanta, Georgia 
Baltimore, Maryland 
Boston, Massachusetts 
Bristol, Pennsylvania 

PRIVATELY FUNDED OICS 



Nashville, Tennessee 
Norfolk, Virginia 
St. Paul, Minnesota 
Xenia, Ohio 



Augusta, Georgia 
Greensboro, North Carolina 
Jackson, Mississippi 



Orlando, Florida 
Richmond, Virginia 
Salisbury, Maryland 



£ 

Formerly funded under the tri-agency agreement between Labor, HEW, and 0E0. 

b The models represent OICs that are exceptional as to quality and are used also for the 
onsite training of OIC and Institute professional staff. 
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RESULTS OF GAO FOLLOW-UPS WITH 
EMPLOYERS ON SELECTED JOB PLACEMENTS 

To examine into the employment experience of former OIC 
enrollees, we inquired of the named employers about the job 
status of 824 persons who were shown in OIC records to have 
been placed in full-time jobs during calendar year 1969. 

The named employers of 649 of the former enrollees responded. 
The responses were received by us during a 5-month period, 
February through June 1970. OIC records showed that, of the 
649 former enrollees for whom responses to our inquiries were 
recei.ved, 495 had received some vocational training at the 
OICs . 



The named employers of the 495 former enrollees in- 
formed us that 428 had been employed by them and that 227, 
or about 53 percent, still were employed by them. The em- 
ployers named in the records informed us that they had no 
record of employment for the 67 other former enrollees. 

Characteristics of the 428 former enrollees who had 
been employed or who still were employed by the named em- 
ployers are, as follows: 



Education completed Age 







Sex 


Grade 12 


Grade 11 


Un- 


Under 


21- 


31- 


Over 


Un- 


Still 


Total 


Male 


Female 


or higher 


or lower 


known 


21 


30 


40 


40 


known 


employed 
No longer 


227 


66 


161 


54 


30 


143' 


38 


92 


39 


23 


35 


employed 


201 


80 


121 


58 


39 


104 


33 


71 


38 


27 


■32 


Total 


428 


146 


282 


112 


6£ 


247 


7X 


163 


ZZ 


5£ 


£Z 



The former enrollees who still were employed by the 
named employers had been employed, on the average, about 
8 months at ;the time of the employers' responses. The 
length of employment ranged from about 2 months to more than 
18 months . 
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Of the 201 persons no longer employed, 29 percent had 
worked for the employer less than 1 month, 46 percent for 
1 to 6 months, 17 percent for 6 to 12 months, and 2 percent 
for more than 12 months. This information was not provided 
to us for the remaining 6 percent. Of the 201 persons no 
longer employed, 50 percent were reported by the employers 
to have left their jobs voluntarily and 46 percent were dis- 
charged; for the remaining 4 percent, the employers did not 
provide us with the reasons for separation. The persons 
who left their jobs voluntarily gave their employers the 
following reasons for leaving. 

Percentage 

Reason Male Female 



Obtained or seeking another job 


18 


16 


Returned to school 


9 


1 


Personal reasons 


6 


14 


Illness 


15 


4 


Dissatisfied with job 


18 


11 


Moved 


6 


11 


Other 


4 


11 


No reason given by the person or he 
failed to report back to work af- 
ter starting the job 


24 


32 


Total 


100 


100 



According to their employers the former enrollees were 
discharged from their jobs for the following reasons. 



Percentage 



Reason 


Male 


Female 


Cutbacks in jobs 


31 


30 


Excessive absenteeism 


29 


20 


Inadequate job performance 


17 


24 


Lack of job skills 


13 


10 


Unable to get along with other em- 
ployees or general attitude in- 
adequate 


2 


6 


Other 


4 


6 


Employer not responsive to question 


4 


4 


Total 


100 


100 



80 



75 



APPENDIX II 



Of the persons no longer employed, 59 either were dis- 
charged by their employers or voluntarily terminated their 
employment within the first month. According to their em- 
ployers, about 38 percent of these persons were discharged 
because of high absenteeism, inadequate performance on the 
job, or a lack of job skills and 20 percent quit their jobs 
without giving reasons or simply failed to report back to 
work. Such situations raise serious questions as to whether 
these persons were provided with the necessary motivation 
and job skills while enrolled in the OIC program or with the 
needed supportive services thereafter. 

At the time of the employers' responses, the employers 
reported wages for the 66 males who still were employed and 
for the 80 males who either had been discharged by their 
employers or had voluntarily terminated their employment 
with the named employers, as follows: 



Number of males 



St ill employed No longer employed 



Wage 


Starting 

rate 


Current 

rate 


Starting 

rate 


Terminal 

rate 


Up to $1.50 an hr. 








— 


$1.51 to $2 " " 


13 


8 


10 


8 


$2.01 to $2.50 an hr. 


24 


11 


19 


17 


$2,51 to $3 an hr. 


16 


21 


14 


10 


$3.01 to $3.50 an hr. 


3 


16 


8 


11 


$3.51 to $4 an hr. 


3 


2 


10 


10 


Over $4 an hr. 


4 


5 


14 


16 


Employer not responsive 
to question 


_3 


_3 


_5 


_8 


Total 


§6 


£6 


M 


M 



The wages reported for the 161 females who still were 
employed at the time of the employers' responses and for the 
121 females who either had been discharged by their employ- 
ers or had voluntarily terminated their employment are, as 
follows : 
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Number of females 



Still employed No longer employed 



Wage 


Starting 

rate 


Current 

rate 


Starting 

rate 


Terminal 

rate 


Up to $1.50 an hr. 


5 


3 


4 




$1.51 to $2 an hr. 


99 


58 


74 


47 


$2.01 to $2.50 an hr. 


40 


76 


26 


42 


$2.51 to $3 an hr. 


9 


10 


1 


7 


$3.01 to $3.50 an hr. 


2 


2 


1 


2 


$3.51 to $4 an hr. 


- 


- 


1 


— 


Over $4 an hr. 


- 


- 


— 


- 


Employer not responsive 
to question 


6 


12 


14 


23 


Total 


161 


161 


121 


121 



The starting wages of the persons in our sample ranged 
from $1,08 to $5.70 an hour. The average hourly starting 
wages for persons placed by each of the five OICs were: 



QIC 


Still 

employed 


No longer 
employed 


Dallas 


$1.85 


$1.87 


Milwaukee 


2.20 


1.98 


Oklahoma City 


1.94 


1.81 


Philadelphia 


2.17 


2.25 


Seattle 


2.62 


3.23 



At the time of the employers* responses, the persons who 
still were employed were earning between $1.08 and $4.54 an 
hour; those persons who no longer were employed by the named 
employers were earning between $1.40 and $5.70 an hour at the 
time of termination. The average hourly wages for these per- 
sons at the time of the employers' responses or at the time 
of termination were: 





Still 


No longer 


QIC 


employed 


employed 


Dallas 


$2.05 


$1.92 


Milwaukee 


2.42 


1.99 


Oklahoma City 


2.15 


1.81 


Philadelphia 


2.37 


2.40 


Seattle 


2.75 


3.30 


■ . *» * j 
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OFFICE OF ECONOMIC 

OPPORTUNITY 



EXECUTIVE OFFICE OF THE PRESIDENT 
WASHINGTON, D.C. 20506 



ocr is an 



Mr. Henry Eschwege 
Associate Director 
United States General 
Accounting Office 
Washington, D. C. 20548 

Dear Mr. Eschwege: 



Enclosed are the Office of Economic Opportunity's comments 
on your Draft Report to the Congress of the United States 
entitled, "Assessment of the Operations and Management of 
Opportunities Industrialization Centers." 



I appreciate having the opportunity to submit these com- 
ments and apologize for the delay in submitting them. 



Sincerely, 




Wesley JL ornevik 
Deputy Director 



Enclosure 
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Office of Economic Opportunity Comments on the Draft GAO Report of the Comptroller 
General of the United States entitled: Assessment of Operations and Management 

of Opportunities Industrialization Centers 11 



In that the Office of Economic Opportunity and the Department 
of Labor have already entered into an interagency agreement transferring 
OEO's responsibility for OICs to DOL effective July 1, 1971, we will 
limit our comments to the specific recommendations made by the GAO 
draft report. 



GAO RECOMMENDATIONS AND 0E0 COMMENTS: 

I. Improvements Needed in P rogra m Operations 

GAO draft report, page 37: n We recommend that the three Federal 

agencies develop for inclusion in future funding agreements with 
the OICs, specific uniform eligibility requirements directed 
toward recruiting low- income persons who are unemployed or 
underemployed. We recommend also that the funding agencies provide 
the necessary guidelines and technical assistance to direct the 
recruiting activities toward the defined target population. M 

0E0 Comment : Although the Office of Economic Opportunity has 

always imposed on its OIC grantees the requirement to enroll 

individuals that meet the 0E0 poverty guidelines, the poverty 

guidelines criteria have not been rigidly enforced during the 

development years of OIC to allow for program acceptability in 

the communities. This allowance has attracted a percentage of 

marginally poor persons into OIC. The great majority of OIC 

enrollees, however, have been eligible for training under the 0E0 

poverty guidelines. The single agency funding arrangement is 

designed to cure this problem. 0E0 will stand ready to assist 

the Department of Labor in seeing that this recommendation is 

implemented. 
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II. Need to Improve Counseling Program 

GAO draft report, page 45: M We recommend that these Federal 

agencies, together with the OIC Institute, encourage the OICs to: 

--develop and use appropriate uniform measurement devices 
which will assist in determining enrollees' vocational 
interests and aptitudes and levels of achievement in 
reading and mathematics. 

QEO Comment : 0E0 believes and our monitoring indicates that 

the ’’Feeder Program”, which is the prevocational component, 
provides the enrollee with a degree of these uniform devices 
already. 0E0 recognizes, however, that the ’’Feeder Program” 
effectiveness varies significantly from program to program and 
will assist DOL in improving the overall ’’Feeder component”. 

GAO draft report , page 45 : 

--provide individual and group counseling on a regularly 
scheduled basis to all enrollees and maintain appropriate 
records thereon. 

QEO Comment : 0E0 considers that OIC has done group and 

individual counseling to some degree. Counseling is an 
important aspect of the program’s design. However, 0E0 
agrees that a more structured counseling program should be 
implemented. 

GAO draft report , page 45 : 

--strengthen procedures for following up on and, if necessary, 
terminating from the program those enrollees absent for long 
periods or leaving the program prior to completion of 
training or job placement. 
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QEO Comment : OEO supports this recommendation but feels that under 

termination standards and procedures flexibility should be employed 
to guard against killing the motivational factor of enrollees. 

GAO draft report , page 45 : 

--identify the factors that cause enrollees to become inactive 
or drop out of the program prior to completion, and take 
whatever action is necessary to alleviate such causes. M 

OEO Comment : OEO agrees that the individual counseling aspect of 

OIC should be increased, which would be one way of identifying 

enrollee problems. OEO also sees some evidence of where the OIC 

has included the enrollee recently in more program participation 

in order to create a situation where better communication will be 

established (i.e., membership on OIC Board of Directors). This 

will serve to identify enrollee problems and improve and strengthen 

the program. 

HI, Need to Improve Effectiveness of Prevocationa 1 Training 

GAO draft report, page 54: "We recommend that the three Federal 

agencies assist the OICs to establish uniform, clearly defined, 
and realistic standards to be used both for assessing enrollee 
needs, progress, and readiness for advancement, and for evaluating 
the effectiveness of the prevocational training component." 

QEO Comment : OEO agrees that prevocational standards are necessary 

and in light of the recent OIC transfer to DOL will assist DOL as 

much as necessary so that the OIC program will continue to improve 

its prevocational training component. 
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IV. Need for Improvements in the Vocational Training Components 

GAO draft report, pages 66 and 67: n We recommend that the 

three Federal agencies require and assist the OICs to 

--establish standards for measuring enrollees 1 progress in 
and possibly on a programwide basis, and periodically 
evaluate such standards; 

0E0 Comment : 0E0 monitoring of OICs indicates that some standards 

for measuring vocational training progress already exist. However, 
we agree that a more systematic approach to evaluating enrollee 
progress will be beneficial. Standards should, of course, have 
flexibility so that the program emphasis will continue to be on 
the program enrollees. 

— periodically evaluate on the basis of enrollee interest, job 
opportunities, and the most effective and efficient use of 
available skill training resources the appropriateness of 
continuing to offer training in each skill area. M 

0E0 Comment : 0E0 agrees that periodic evaluation of the need for 

the types of skilled training offered by the OICs in a particular 

area is necessary to assure that the labor market can respond to 

the trained individuals. 

V. Improvements Needed in Job Placement Records and Repor ts 

GAO draft report, page 72: "We recommend that the three Federal 

agencies require and assist the OICs to maintain adequate records 
of enrollee termination information and to develop a reporting 
system which will provide OICs with appropriate information on 
job placements.: 

0E0 Comment : 0E0 agrees with this recommendation. 
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VI. Need for Improved Follow - Up on Enrollees Placed in Jobs 

GAO draft report, page 79: "We recommend that the three 

Federal agencies require the OICs to make regular follow-up 
contacts with former enrollees who have been referred to 
jobs or have been placed in jobs and with their employers 
and to maintain adequate documentation of such contacts, 11 

0E0 Comment : In a recent evaluation report of OICs 

(dated November 13, 1970), 0E0 recommended that the OIC 

develop a longer period of follow-up with former enrollees. 

OIC already recognizes this recommendation as legitimate and 

has informed 0E0 that the recommendation has been implemented* 

The follow-up period is now extended to one year after referral 

or placement. 

VII . Improvements Needed in Monitoring and Evaluation Efforts end Program Data 

GAO draft report, page 85: "We recommend that the three Federal 

agencies develop a monitoring and evaluation plan which will: 

--define the responsibility for and the timing and degree of 
monitoring and evaluation efforts; 

— establish standards against which program progress can be 
measured; and 

— fix responsibility for assuring that prompt and appropriate action 
is taken on recommendations for improvements. 

Further, we recommend that the Federal funding agencies review 
the design of the OIC management information system and the 0IC*s 
record-keeping procedures and practices with a view toward 
improving the reliability and usefulness of operational data 
needed for monitoring and evaluating purposes and for effective 
program management. 

0E0 Comment : In light of the 0E0 transfer of its OIC responsibilities 

to DOL effective July 1, 1971, we will regard DOL as a lead agency in 
regard to a definie monitoring and evaluation plan designed to comply 
with the recommendation. 0E0 will, of course, assist DOL where appropriate 
in this regard. 
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OEO's comments are made with the understanding that OIC has begun 
to place more emphasis on program management and is aware that program and 
management improvements are always needed. However, our recent evaluation 
of the technical assistance delivery quality of the OIC National Institute, 
where we visited eight OIC projects, indicates that the OICs are overall 
a quality manpower training program. 0E0 foresees the single agency funding 
arrangement will eliminate many of the present problems and create the 
avenue toward implementation of the recommendations in your draft report. 
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DEPARTMENT OF HEALTH. EDUCATION. AND WELFARE 

WASHINGTON. D.C. 20201 



OFFICE OF THE SECRETARY _ _ 

SEP 8 197! 




Mr. Henry Eschwege 
Associate Director, Civil Division 
U.S. General Accounting Office 
Washington, D.C. 20548 

Dear Mr. Eschwege: 

The Secretary has asked that I reply to your letter dated June 18, with 
which you forwarded the draft report of the General Accounting Office 
entitled, "Assessment of Operations and Management of Opportunities 
Industrialization Centers." The Centers are funded and administered 
by the Office of Economic Opportunity and the Departments of Labor 
and Health, Education, and Welfare. 

Detailed comments on the recommendations, together with the state- 
ments of actions to be taken to implement them, are set forth in the 
enclosure. They are the product of a review of the report by cogni- 
zant Departmental and Office of Education staff. 



In addition to our comments on these recommendations, we concur 
fully in the conclusion reached by GAO that changes are needed in the 
manner that 010*3 are funded. In our judgement, the Administration^ 
pending Manpower Revenue Sharing legislation, if enacted, would 
serve to overcome most, if not all, of the problems cited in the GAO 
audit. One of the main themes of this legislation is to "unify into one 
the many programs under which Federal manpower money is now 
channeled to State and local governments. 



We appreciate the opportunity to review and comment on the report. 



Sincerely yours. 




i&i d^o L ii C s 

James B. Cardwell 

Assistant Secretary, Comptroller 



Enclosure 
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Department Comment 



VJe concur in the recommendation. 

Through the vehicle of the single contract concept, it is expected 
that more uniform and clearly defined standards will be developed. 
As previously stated, the AMDS Centers are presently working with 
the Institute in this area. 



The GAO recommended that the three Federal agencies require and assist 
the QIC's to establish standards for measuring enrollee's progress in 
and completion of vocational training courses, p erio dically evaluate 
such standards, and periodica ll y evaluate on the basis of enrollee 
interest, job opportunities, and the most effective and efficient 
use of available skill training resources the appropriateness of 
continuing to offer training in each skill area. 



Department Comment 

VJe concur in the recommendation. 

This Department is currently making plans to experiment with the 
Institute in the area of performance testing as opposed to regular 
achievement testing. In addition, as previously stated, v/e are expect- 
ing the single contract concept to provide standards and uniformity. 



The GAO recommended that the, three Federal agencies require and assist 
the QIC's to maintain adequate records of enrollee* s termination 
information and to develop a reporting system which will provide QIC's 
with appropriate Information on job placements . 

Department Comment 

We concur in the recommendation. 

Although job placement is a specific responsibility of the U. S. Employ- 
ment Service component of the OIC contract, the AMIDS Centers are 
assisting them in this effort; and this Department is sharing with 
them the pertinent experience gained in administering the Manpower 
Skill Centers. 
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Department of Health, Education, and Welfare 
Comments Pertinent to the Draft of Report to the Congress of the 
United States by the United States General Accounting Office 
on Assessment of Operations and Management of 
Opportunities Industrialization Centers 



The GAO recommended that the three Federal agencies develop specific 
uniform eligibility requirements directed toward recruiting low-income 
persons who are unemployed or underemployed, and that funding agencies 
should provide the necessary guidelines and technical assistance to 
dir. ict the recruiting activities toward the defined target population . 

Department Comment 

We concur in the recommendation. 

Currently, all individual OIC's will be funded through a single direct 
contract with the OIC Institute in Philadelphia, Pennsylvania. This 
approach should inherently encourage the development of more uniform 
requirements in all areas. Although recruitment is a function of the 
U.S. Employment Service, this Department is cooperating with the 
Department of Labor in an attempt to improve the procedures. 



The GAO recommended that the three Federal agencies, together with the 
OIC Institute, encourage the OIC's to develop an improved counseling 
program . 

Department Comment 

We concur in the recommendation. 

This Department has made provisions for the OIC Institute to receive 
assistance from the AMIDS (Area Manpower Institutes for the Develop- 
ment of Staff) Centers funded under the Manpower Development and 
Training Act and located in seven strategic areas throughout the 
country. We believe these Centers will provide the necessary 
guidance to improve counseling service. 



The GAO recommended that the three Federal agencies assist the PIC's 
to establish uniform, clearly defined, and realistic standards to be 
used both for assessing enrollee needs, Progress, and readiness for 
advancement, and for evaluating the effectiveness of the prevocational 
training component. 
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The GAO recommended that the three Federal agencies require the QIC's 
to make regular follow-up contacts with former enrollees who have 
been referred to jobs o r have been placed in jobs and to maintain 
adequate documentation of such contacts . 

Department Comment 

Wc concur in the recommendation. 

Our response to job placement records and reports should be considered 
our response to job development as well. 



The GAO recommended that the three Federal agencies develop a monitor- 
ing and evaluation plan and review the design of the QIC management 
information system and recordkeeping procedures . 

Department Comment 

We concur in the recommendation. 

This Department, through the AMIES Centers, is providing technical 
assistance to the OIC's to improve the management information system 
and recordkeeping procedures. However, this Department would be 
pleased to join with the Department of Labor and the Office of 
Economic Opportunity to develop a monitoring and evaluation plan 
as recommended. 
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DEC 3 0 1971 



U.S. DEPARTMENT OF LABOR 

Office of the Assistant Secretary for Administration 
WASHINGTON, D.C. 20210 




Mr. Henry Eschwege 
Associate Director 
Civil Division 

U. S. General Accounting Office 
Washington, D. C. 20548 



Dear Mr. Eschwege: 

This is in response to your request for comments on the draft report 
entitled "Assessment of Operations and Management of Opportunities 
Industrialization Centers." 

Most of the recommendations had validity for the period ending 
February 1971, which was the conclusion of the 12-month survey made 
by the GAO evaluators. However, there have been significant modifi- 
cations in this program as it now functions, as compared with its 
operation as an Experimental and Demonstration program. 

During the GAO survey period, the OIC was funded through individual 
contracts by three (3) Federal agencies with three (3) separate con- 
tracts for each local OIC. The programs were operated as delegate 
agencies under the local community action agencies and funded under 
a cumbersome tri-agency arrangement involving the Department of Labor, 
Health, Education and Welfare, and the Office of Economic Opportunity. 
The OIC program was not in the position as it is today, which is that 
of a prime contractor under a "bulk funding," single agency agreement 
between the U. S. Department of Labor and the OIC National Institute. 
The 0E0 and U. S. Department of Health, Education and Welfare have 
transferred funds to this Department for purposes of this contract. 

The OIC Institute now constitutes a point of accountability for local 
performance, whereas under the Experimental and Demonstration (E&D) 
concept, the Institute acted in an advisory capacity without authority 
to take corrective action. Under the current contractual arrangement, 
the OIC Institute is responsible for management and performance of 
the individual OICs . This has resulted in the establishment of per- 
formance standards, record-keeping, and program operations and 
management . 
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I have enclosed for your information the "Fiscal Manual" prepared by 
OIC and issued on August 15, 1971. Also enclosed is the proposed "OIC 
National Institute Program Performance Standards" covering intake, 
counseling, staff functions, trainee placements, and follow-up procedures. 
These manuals, covering the program and fiscal areas, answer all of the 
problems cited in your report and should therefore be part of the record. 

The single agency prime contract, negotiated and finalized in March 
1971, under which the local OIC programs are now funded, is in accord 
with the recommendations made in the proposed GAO report to Congress. 

It is stated specifically that "the funding arrangements of OICs need 
to be changed to reduce the administrative work load of both the OICs 
and the federal agencies." 

I am confident that you appreciate the evolvement of OICs from the 
status of experimental and demonstration, under which a more liberal 
set of standards and policies were permitted, to a regularly funded 
manpower program. The program was originated on the basis of open 
enrollments. All who came to OIC for assistance were encouraged to 
take advantage of the services available, which was not the case with 
most of the major manpower programs funded by the various Federal 
agencies. OIC continues to have an interest in the "marginally" poor, 
i.e., those who need assistance but are slightly above the poverty 
level of income. It is significant to understand that this all- 
inclusive concept could only be achieved if training allowances were 
not paid to the enrollees , as is the case with the OIC program. 

I, of course, agree that strict application of the poverty criteria 
should be applied when the payment of allowances is required. Of the 
five centers surveyed, the Seattle center was an exceptional case in 
that allowances were paid under a Concentrated Employment Program con- 
tract, but this was not applicable to the other four nor is it appli- 
cable to OIC in general. As an experimental program OIC was not 
required to adhere to the operational definition of the "disadvantaged," 
in fact, the "poor" criteria were defined and issued at a later date 
by the Office of Economic Opportunity. Unless OICs are analyzed and 
placed in chronological perspective, basic differences in time and 
program objectives existing at the particular time understandably 
create considerable difficulty when interpreting and analyzing the 
program results, as indicated in your report. 

As OIC evolved from an experimental to a regular manpower program in 
1970, it did give more attention to the important function of program 
records, financial reports, and related cost benefit analyses. Further 
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emphasis has been placed upon developing effective administrative and 
operational techniques which will enable the OICs to better serve their 
intended beneficiaries while providing reliable measures of data and 
program accomplishments . 

The following is in response to the specific recommendations made in 
the report. 

1. GAO Recommendations on Recruiting and Counseling 

The GAO recommends that the Federal agency develop for inclusion 
in future funding agreements with the OIC specific uniform eligibility 
requirements directed toward recruiting low-income persons who are 
unemployed or underemployed, and further provide the OICs with the 
necessary guidelines and statistics to do so. 

While the OIC does not strictly observe the poverty level criteria, 
it does observe the criteria as set forth under the Economic Opportunity 
Act and the Manpower Development and Training Act and directs its 
outreach efforts to servicing a disadvantaged unemployed and under- 
employed population. This Department believes that OIC should continue 
to maintain an "open door" policy and not attempt to screen out appli- 
cants. The "open door" policy is important to fostering motivation 
among the marginally disadvantaged, because it eliminates a psycholog- 
ical barrier which tends to make the individual believe that the 
system is not designed to assist him, which has all too often been 
an accurate assessment. 

OIC has provided workshops and training sessions for recruitment 
staff in order that they be made fully aware of the various federal 
requirements for participation in training programs. The OIC concept 
does not include the provision of training allowances and this program, 
therefore, is in a position to serve a more diverse community popula- 
tion. In summary, we have moved effectively to establish clearly 
defined and realistic criteria for enrollment of the unemployed and 
underemployed as indicated in the enclosed proposed "Performance Stan- 
dards". 

2. Recommendations on Vocational Interest, Aptitudes and Counseling 

GAO suggested the development and use of appropriate uniform 
measurement devices for determining enrollees' vocational interests 
and aptitudes. 
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The OIC programs are currently using various programmatic measure- 
ment devices appropriate to the local OIC operation for these specific 
areas. I again refer you to the enclosed "Program Performance 
Standards . " 

GAO recommends that OIC be encouraged to provide individual and 
group counseling sessions on a regularly scheduled basis to all 
enrollccs and maintain appropriate records. Very definite performance 
standards providing quantitative and qualitative analyses of counseling 
sessions are now included in the OIC "Performance Standards" and are 
placed in the enrollees ’ permanent records. The local OIC program will 
be monitored and measured for effectiveness by the OIC Institute. 

In summary, the Department agrees with your recommendation, and 
effective action has been implemented to assure adequate individual 
and group counseling. However, there are no objective testing measures 
which have been developed using this population as a nominative group 
and, as a result, OIC relies upon a variety of inputs from all parties 
concerned directly with the client. In the program period covered by 
the GAO survey, various methods of testing were used. For example, in 
the specific case of the Dallas OIC, aptitude testing was utilized if 
the applicant requested it, or if the individual demonstrated little 
interest in any vocational training. Manual dexterity training is 
often used in the OIC programs when this type of testing is applicable 
for the particular training to be offered, i.e., keypunch training, 
clerical skills and other areas where this is an important requirement 
for success on the job. The OIC National Institute is working with 
local OICs to more accurately assess the trainees potential, but this 
cannot be assured with any degree of certainty. 

3. GAO Recommends Strengthening Procedures for Follow-up . 

The GAO report suggests strengthening procedures for follow-up and 
an adequate record system on employee placement. The OIC program, 
since the GAO survey, has implemented a central records unit system in 
all of the local OIC programs. Part and parcel of the CRU system is 
a definite standard trainee follow-up procedure, including permanent 
records of the trainee and contacts which are made with the trainee 
and the employer. 

The Department of Labor is requiring, and through the OIC National 
Institute is assisting, the local OICs to maintain adequate records 
covering all aspects of enrollee activities, from the initial recruit- 
ment through post-placement follow-up. Further, GAO recommends that 
follow-up contact with former enrollees who have been referred to jobs 
be made. 
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The OIC National Institute is now requiring that all of its subcon- 
tractors have an established follow-up capability. Records which are 
now being maintained include not only the numbers placed but also 
back-up information, names, placements, dates, skill areas completed, 
and follow-up after placement for one year. 

4 . GAO Recommends that OIC Identify the Factors that Cause Enrollees 

to Become Inactive or to Drop Out . 

The need to know the reasons for a high dropout rate, of course, is 
an important function of effectively administering a manpower program. 
Termination interviews with enrollees are now being considered as a 
method for determining the reasons for drop-outs. However, the factors 
involved in determining causes of drop-outs have roots in a myriad of 
social and economic conditions ranging from the early and immediate 
family relationships to current income and family circumstances. To 
the degree that more effective counseling can reduce employee discon- 
tinuance, OIC is employing this technique. 

Examples of the actions taken are the Oklahoma City and Dallas OIC 
programs where studies are being conducted to determine exactly why 
drop-outs have occurred. In the case of Dallas, the rate of early 
termination has decreased from sixty (60) percent in 1970 to forty 
(40) percent in 1971. A major factor in enrollee discontinuance is 
that many adult enrollees simply cannot afford to continue in training 
without some financial assistance. 

To alleviate this problem, many OIC locals have initiated a 
Brotherhood Fund which provides carfare and lunch money in an attempt 
to relieve these adverse economic conditions. Philadelphia, Oklahoma 
City, Dallas, and Milwaukee have instituted Brotherhood Funds from 
private sources . One of the reasons the records of attendance were 
better in the Seattle project is that there was more substantial 
financial assistance available to the trainee. Since the GAO eval- 
uation was undertaken, there have been several changes in the courses 
offered by the local OICs. To the extent that the courses are more 
relevant to the trainee's interest and more directly related to jobs 
currently available in the employment market, there will be a higher 
rate of retention and consequently fewer dropouts. For example, the 
Philadelphia operation has terminated several occupational training 
areas and added others, e.g., proof machine operators and office 
practices courses have been added because employment opportunities for 
these occupations are favorable. 
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The OIC program has achieved success in receiving certification 
from the Veterans Administration, whereby veterans receive full G.I. 

Bill allowances while undergoing training at the centers. These 
allowances provide financial assistance to the trainee and thereby 
reduce the economic handicap which reduces the dropout rate insofar 
as the reasons are economically related. 

The OIC and this Department are securing relationships with other 
manpower programs in which allowances are paid which will allow parti- 
cipation in OIC training programs with incentive payments. This form 
of financial assistance will be helpful in resolving some of the pro- 
blems attributed ■ to economic hardship. „ 

The OIC Institute has issued standards and is assisting local OICs 
in the adoption of uniform termination policies designed to insure 
that training slots are not filled by individuals who are not interested 
in the program. 

At the time of the GAO survey, the OIC program was not operating 
under the current Central Records Unit (CRU) system. Terminations 
were basically considered dropouts, prior to the implementation of this 
system which now includes provision for the reporting of four following 
major termination areas: 

1) . Referral to other programs 

2) Employability plan completed (job placement) 

3) Dropouts 

4) Other output; this latter category provides for such 'positive 
discontinuances" as pregnancy, Armed Services induction, 
moving out of the area, etc. 

It is .important to note that OIC programs surveyed by GAO showed 
4,650 "terminations." Of this total, according to the GAO report , 

2,850 "dropped out" and 1,800. were either placed in. jobs, in the process 
of being. placed in jobs, or referred to other training programs. The 
total cost of these five training programs during the survey was 
approximately $4,364,000. Based on this cost, the 1,800 individuals 
reported .were provided placement services at a cost of $2,400 each. 

The important aspect not reported by GAO is that OIC, while main- 
taining an "open door" policy, served more than 4,600 individuals and 
placed 1,800. A variety of manpower services were provided to the 
2,850 trainees who did not remain in the program through placement. 

Such services undoubtedly were of assistance to these individuals when 
they sought employment on their own initiative. Regardless of this, 
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the end result of any manpower program is jobs, and the cost of approxi 
mately $2,400 for 1,800 placements is reasonable. • 

5. GAO Recommends Clearly Defined .and Realistic- Standards for Prevoca- 

tional and Vocational Training .. v - . . 

GAO states there is a need to establish uniform, clearly^ defined • 
and realistic standards to be used during the prevocational training- 
component for assessing enrollee needs and readiness for- vocational 
training. ... <.•••,.. * * , ^ 

Individual OICs, the OIC National Institute, and the Department of 
Labor are working together to finalize these standards. This includes 
standards for measuring and evaluating enrollee progress toward 
completion of training, and progress forms are presently being main-; 
tained for the trainees to assist in their evaluation..' These standards 
will guarantee the effectiveness of the prevocational and vocational 
training aspects of the program. , 

The appropriateness of continuing to offer certain vocational.^: ] \ 
training courses is also being evaluated. Changes in local employment" 
conditions, varying enrollee interests and the economy in general, 
affect this aspect of the program. The OIC National Institute as the 
prime contractor requires that each of its subcontractors' have active 
and viable Industrial Technical Advisory Councils. These Councils . / 
are especially effective in determining the appropriateness of voca- 
tional training courses relative to the job market. 

6. GAO Recommends that a Monitoring and Evaluation Plan be Developed . 

The OIC local centers are being regularly monitored and evaluated 
through a plan which has been developed by the OIC National Institute 
in conjunction with the Department of Labor. This plan defines the 
responsibility for the timing and degree of monitoring and evaluation, 
establishing standards against which program progress can be measured, 
and it fixes responsibility. 

During calendar year 1971, an overall national evaluation of OIC 
will be conducted . This evaluation will be initiated by the Department 
of Labor in order to assess the degree to which the OIC program 
nationally is functioning effectively and consistently toward achiev- 
ing the objectives contained in the national contract. The evaluation 
will include a review of the adequacy of the OIC management information 
system, record-keeping procedures, and data-gathering practices. The 
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OJ.C programs heretofore, and in particular during the period of the 
GAO survey, received limited monitoring and evaluation from the three 
Federal agencies. This was a primary reason why a single agency 
contract with the Institute was deemed economically and administra- 
tively essential. Monitoring and evaluation were not well planned 
and programmed because of conflicting legislative and Federal agency 
responsibilities. The OIC National Institute was provided a "technical 
assistance" grant and requested to advise and monitor local programs 
that retained responsibility and authority for their own activities. 

This has since been corrected under the "bulk funding" contract 
with the OIC National Institute as the prime contractor with this 
Department acting as the lead Federal agency. Thus, monitoring and 
overall management in accord with the national contract is now the 
responsibility of the OIC Institute. However, the Department of 
Labor will review and evaluate the Institute. 

I appreciate the opportunity to comment on the draft of the GAO report 
and hope our comments will be of use in making a correct and adequate 
assessment of the OIC program. ' 




r Asiistint secretary 

for Administration ar.c; Management 
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PRINCIPAL OFFICIALS OF 
THE DEPARTMENT OF LABOR, 

THE DEPARTMENT OF 
HEALIH, EDUCATION, AND WELFARE, 

AND THE OFFICE OF ECONOMIC OPPORTUNITY 
RESPONSIBLE FOR ADMINISTRATION OF ACTIVITIES 
DISCUSSED IN THIS REPORT 



Tenure of office 
From To 

DEPARTMENT OF LABOR 

SECRETARY OF LABOR: 



James D. Hodgson 


July 


1970 


Present 


George P. Shultz 


Jan. 


1969 


June 


1970 


W. Willard Wirtz 


Sept. 


1962 


Jan. 


1969 


ASSISTANT SECRETARY FOR MANPOWER: 










Malcolm R. Lovell 


July 


1970 


Present 


Arnold R. Weber 


Feb. 


1969 


June 


1970 


Stanley H. Ruttenberg 


June 


1966 


Jan. 


1969 


MANPOWER ADMINISTRATOR: 










Paul J. Fasser, Jr. 


Oct. 


1970 


Present 


Malcolm R„ Lovell 


June 


1969 


Oct. 


1970 


J. Nicholas Peet 


Feb. 


1969 


June 


1969 


William Kolberg (acting) 


Jan. 


1969 


Feb. 


1969 


Stanley H. Ruttenberg 


Jan. 


1965 


Jan. 


1969 




DEPARTMENT OF HEALTH, EDUCATION, AND WELFARE 

SECRETARY OF HEALTH, EDUCATION, 

AND WELFARE: 

Elliot L. Richardson June 1970 Present 

Robert H. Finch Jan. 1969 June 1970 
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Tenure of office 
From To 



DEPARTMENT OF HEALTH, EDUCATION AND WELFARE 

(continued) 

SECRETARY OF HEALTH, EDUCATION 
AND WELFARE: (continued) 



Wilbur J. Cohen 


Mar. 


1968 


Jan. 


1969 


John W. Gardner 


Aug. 


1965 


Mar. 


1968 


ASSISTANT SECRETARY (EDUCATION) 
(note a) : 


James E. Allen, Jr. 


May 


1969 


June 


1970 


Peter P. Muirhead (acting) 


Jan. 


1969 


May 


1969 


Lynn M. Bartlett 


July 


1968 


Jan. 


1969 


Paul A. Miller 


July 


1966 


July 


1968 


Francis Keppel 


Oct. 


1965 


May 


1966 


COMMISSIONER OF EDUCATION: 


Sidney P. Marland, Jr. 


Dec. 


1970 


Present 


Terrel H. Bell (acting) 


June 


1970 


Dec. 


1970 


James E. Allen, Jr. 


May 


1969 


June 


1970 


Peter P. Muirhead (acting) 


Jan. 


1969 


May 


1969 


Harold Howe, II 


Jan. 


1966 


Dec. 


1968 


ASSOCIATE COMMISSIONER, BUREAU OF 
ADULT, VOCATIONAL, AND TECHNICAL 
EDUCATION, OFFICE OF EDUCATION: 


Robert M. Worthington 


Aug. 


1971 


Present 


Frank. B. McGet trick (acting) 


June 


1971 


July 


1971 


Arthur L. Hardwick 


July 


1970 


May 


1971 


Grant Venn 


May 


1966 


June 


1970 


John R. Ludington (acting) 


July 


1965 


May 


1966 



OFFICE OF ECONOMIC OPPORTUNITY 

DIRECTOR, OFFICE OF ECONOMIC OP- 
PORTUNITY: 

Phillip V. Sanchez Sept. 1971 Present 

Frank. C. Car luce i Dec. 1970 Sept. 1971 

a This position was abolished in June 1970. 
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Tenure of office 
From To 

OFFICE OF ECONOMIC OPPORTUNITY (continued) 



DIRECTOR, OFFICE OF ECONOMIC 
OPPORTUNITY: (continued) 



Donald Rumsfeld 


May 


1969 


Dec. 


1970 


Bertrand M. Harding (acting) 


Mar. 


1968 


May 


1969 


R. Sargent Shriver 


Oct. 


1964 


Mar. 


1968 


ASSISTANT DIRECTOR FOR COMMUNITY 
ACTION PROGRAMS (note a): 


Theodore M. Berry 


Apr. 


1965 


Sept. 


1969 


ASSISTANT DIRECTOR FOR OPERATIONS: 


Roy E. Batchelor 


Nov. 


1971 


Present 


H. Rodger Betts (acting) 


Sept. 


1971 


Nov. 


1971 


Phillip V. Sanchez 


Feb. 


1971 


Sept . 


1971 


Donald I. Wortman (acting) 


Dec. 


1970 


Feb. 


1971 


Frank C. Car luce i 


Dec. 


1969 


Dec. 


1970 


William Bozman (acting) 


Oct. 


1969 


Dec. 


1969 



ct 

In September 1969, this position was terminated as an orga- 
nizational entity and responsibility for administering the 
program was shifted to the newly created Office of Opera- 
tions . 
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Copies of this report are available from the 
U. S. General Accounting Office, Room 6417, 
441 G Street, N W., Washington, D.C., 20548. 

Copies are provided without charge to Mem- 
bers of Congress, congressional committee 
staff members, Government officials, members 
of the press, college libraries, faculty mem- 
bers and students. The price to the general 
public is $1 .00 a copy. Orders should be ac- 
companied by cash or check. 





